Quote:
Originally Posted by steve27
When Google crawls a new site for the first time, they will only index the home page.
Later the depth up to where your site will be spidered depends on the pagerank.
The crawlers use time-slots for each site, the higher your page rank the more time the crawler will allocate for its attempt to spider your site.
|
It is NOT the PageRank of the page that determines crawl rate and depth, but the same thing that creates PageRank for a page, and that is the links and the REAL PR of those links.
Quote:
Originally Posted by steve27
Then it all depends on the spiderability of your pages, how fast they load, code/text ratio. Whenever the time is up the crawler will leave and only continue next time.
|
Nope, bots don't "wait" for a page to load, they simply grab the HTTP response code and the source code that the server sends out on request, stream it back to the datacentre and then leave. This takes a few hundred microseconds or a few milliseconds at worst.
They are NOT rendering images, NOT loading javascript, NOT downloading objects (flash, quicktime videos etc), NOT loading CSS files or any other kind external files. This is what comprises the loading time in a browser.
Code to text ratio?? pure bunkum
see http://videos.webpronews.com/2006/12...ogle-sitemaps/ at time index 13:00
__________________
Chris. ->> Links are advertising NOT optimising!! <<-
A foolish consistency is the hobgoblin of little minds
Thought for today:- I SEO the only industry where all the cowboys are Indians?
|