Tycoon Talk
Become a Big fish!
The number 1 forum for online business!
Post topics, ask questions, share your knowledge.
Tycoon Talk is part of Freelancer.com - find skilled workers online at a fraction of the cost.

The Google Forum


You are currently viewing our The Google Forum as a guest. Please register to participate.
Login



Reply
Old 12-10-2008, 03:36 PM Crawl Rate
Skilled Talker

Posts: 95
Trades: 0
I'm reading abour crawl rate and it seems very important.

I have attached my crawl stats from GWT.

Also, can somebody explain crawl rate settings in GWT. Currently is checked "Let Google determine my crawl rate (recommended)". In which case I need to increase speed and will it decrease a quality of indexing?

My current sitemap stats:
Total URLs: 3469
Indexed URLs: 2965
Attached Images
File Type: png Picture 1.png (25.1 KB, 4 views)
igorsa is offline
Reply With Quote
View Public Profile
 
 
Register now for full access!
Old 12-10-2008, 03:43 PM Re: Crawl Rate
chrishirst's Avatar
Missing! presumed drunk.

Posts: 41,517
Name: Chris Hirst
Location: Blackpool. UK
Trades: 0
Quote:
I'm reading abour crawl rate and it seems very important
It's not.
__________________
Chris. ->> Links are advertising NOT optimising!! <<-
A foolish consistency is the hobgoblin of little minds
Thought for today:- I SEO the only industry where all the cowboys are Indians?
chrishirst is offline
Reply With Quote
View Public Profile Visit chrishirst's homepage!
 
Old 12-11-2008, 08:02 AM Re: Crawl Rate
Novice Talker

Posts: 12
Trades: 0
Crawl rate is basically the time Google waits between sending requests. I personally would let Google bot determine how fast it needs to go
__________________

Please login or register to view this content. Registration is FREE


Please login or register to view this content. Registration is FREE


Please login or register to view this content. Registration is FREE

Last edited by Avitus; 12-11-2008 at 08:05 AM..
Avitus is offline
Reply With Quote
View Public Profile
 
Old 12-11-2008, 08:24 AM Re: Crawl Rate
Skilled Talker

Posts: 95
Trades: 0
But look again:

Total URLs: 3469
Indexed URLs: 2965

If I say Google to send requests often, will these 2 numbers be more equal?
igorsa is offline
Reply With Quote
View Public Profile
 
Old 12-11-2008, 08:30 AM Re: Crawl Rate
johnlloyd's Avatar
Super Spam Talker

Posts: 836
Name: John Lloyd
Trades: 0
I don't think that crawl rate is that important and in fact you can change rate of crawling your site!

Quote:
You can change the crawl rate (the time used by Googlebot to crawl the site) for sites that are at the root level - for example, www.example.com and http://subdomain.example.com. You can't change the crawl rate for sites that are not at the root level - for example,
http://www.google.com/support/webmas...e&topic=&type=
__________________

Please login or register to view this content. Registration is FREE
||
Please login or register to view this content. Registration is FREE
johnlloyd is offline
Reply With Quote
View Public Profile Visit johnlloyd's homepage!
 
Old 12-11-2008, 09:26 AM Re: Crawl Rate
chrishirst's Avatar
Missing! presumed drunk.

Posts: 41,517
Name: Chris Hirst
Location: Blackpool. UK
Trades: 0
Quote:
If I say Google to send requests often, will these 2 numbers be more equal?
No.

How many pages on the site are behind forms? these will not be crawled.
How many pages on the site are excluded in robots.txt? these will not be crawled.
How many pages on the site are blocked by a robots meta? these will not be crawled.
How many pages on the site are in password protected folders? these will not be crawled.

Count the URLs that bots are blocked from and I would expect your apparent disparity is reduced somewhat.
__________________
Chris. ->> Links are advertising NOT optimising!! <<-
A foolish consistency is the hobgoblin of little minds
Thought for today:- I SEO the only industry where all the cowboys are Indians?
chrishirst is offline
Reply With Quote
View Public Profile Visit chrishirst's homepage!
 
Old 12-15-2008, 11:43 PM Re: Crawl Rate
Super Talker

Posts: 115
Name: Surbhi
Trades: 0
You need to keep your crawl rate medium in each case.
__________________

Please login or register to view this content. Registration is FREE

Please login or register to view this content. Registration is FREE

Please login or register to view this content. Registration is FREE

Please login or register to view this content. Registration is FREE

Please login or register to view this content. Registration is FREE

Please login or register to view this content. Registration is FREE

Please login or register to view this content. Registration is FREE
swity is offline
Reply With Quote
View Public Profile Visit swity's homepage!
 
Old 12-16-2008, 12:06 AM Re: Crawl Rate
Skilled Talker

Posts: 53
Location: India
Trades: 0
i don't think that crawl rate is that much important.
__________________

Please login or register to view this content. Registration is FREE
::
Please login or register to view this content. Registration is FREE

aleale is offline
Reply With Quote
View Public Profile
 
Reply     « Reply to Crawl Rate
 

Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are Off
Pingbacks are Off
Refbacks are Off





   
RSS Feed  Feeds: RSS   JS   XML
RSS Feed  Feeds for this forum: RSS   JS   XML



Page generated in 0.27668 seconds with 13 queries