Tycoon Talk
Become a Big fish!
The number 1 forum for online business!
Post topics, ask questions, share your knowledge.
Tycoon Talk is part of Freelancer.com - find skilled workers online at a fraction of the cost.

The Google Forum


You are currently viewing our The Google Forum as a guest. Please register to participate.
Login



Reply
GSiteCrawler - need some help
Old 03-04-2007, 07:39 PM GSiteCrawler - need some help
Skilled Talker

Posts: 66
Trades: 0
Heya, ive read around about google and came across on many places that suggested using GSiteCrawler - reading up on it - its a spider that creates sitemap for Google. Now I got couple of questions.

1. How long do I have to run it, does it stop on its own or can I stop it after some time?

2. It offers to write sitemap file into my server - is it good thing? Can that be potentially harmfull (overwrites some files that shouldnt be or something?)

3. It also offers submit sitemap to Google - now I have not yet submited my site link to Google - as im stil working on it . Now If i would do that would that a. make google aware of my site ( or do I still need to do it manually ) b. does it submit it automatically the sitemap to google? or do I have to do something myself as well

Id apprishiate any advise on this matter.
JTGizmo is offline
Reply With Quote
View Public Profile
 
 
Register now for full access!
Old 03-04-2007, 09:55 PM Re: GSiteCrawler - need some help
chrishirst's Avatar
Missing! presumed drunk.

Posts: 41,517
Name: Chris Hirst
Location: Blackpool. UK
Trades: 0
A google sitemap is only of use IF you have a site that is difficult to crawl or puts obstacles in the way of the SE crawler.
It won't get you any rankings at all.

The only thing you need to make the Search Engines aware of your site is to get some links to it.
__________________
Chris. ->> Links are advertising NOT optimising!! <<-
A foolish consistency is the hobgoblin of little minds
Thought for today:- I SEO the only industry where all the cowboys are Indians?
chrishirst is offline
Reply With Quote
View Public Profile Visit chrishirst's homepage!
 
Old 03-04-2007, 09:59 PM Re: GSiteCrawler - need some help
Skilled Talker

Posts: 66
Trades: 0
Right - then how can I determine whether my site is easy to crawl or not for Google and other SE?
__________________

Please login or register to view this content. Registration is FREE
- Find your people Find your party
Please login or register to view this content. Registration is FREE


Please login or register to view this content. Registration is FREE
- Quality free wallpapers
JTGizmo is offline
Reply With Quote
View Public Profile
 
Old 03-04-2007, 11:00 PM Re: GSiteCrawler - need some help
Skilled Talker

Latest Blog Post:
Free PDF Converters
Posts: 76
Trades: 0
1. It will run till it finishes indexing yor site's urls
2. It only uploads 3 files, the sitemap, the compressed sitemap and a css file for online viewing of the sitemap
3. I think you need to manually submit the sitemap first.
__________________

Please login or register to view this content. Registration is FREE
|
Please login or register to view this content. Registration is FREE
|
Please login or register to view this content. Registration is FREE
solidghost is offline
Reply With Quote
View Public Profile
 
Old 03-04-2007, 11:23 PM Re: GSiteCrawler - need some help
ForrestCroce's Avatar
Half Man, Half Amazing

Posts: 3,023
Name: Forrest Croce
Location: Seattle, WA
Trades: 0
Quote:
Originally Posted by JTGizmo View Post
Right - then how can I determine whether my site is easy to crawl or not for Google and other SE?
Does it have any broken html? Or have you done anything silly like banning all spiders using robots.txt or .htaccess? ( 99.9 % of web sites haven't and you'd know if you have. ) If you don't have a lot of broken tags ( <strong some text here ) you should be fine.

Do you have a lot of images in place of text? People do that with fonts or special effects you can't do with html and css. Spiders can crawl these pages no problem, but they won't be able to ( or even try ) read the text in these images. If you set your site up that way it won't cause problems for GoogleBot, but it might dampen your ratings a little bit.
__________________

Please login or register to view this content. Registration is FREE
|
Please login or register to view this content. Registration is FREE
|
Please login or register to view this content. Registration is FREE
ForrestCroce is offline
Reply With Quote
View Public Profile Visit ForrestCroce's homepage!
 
Old 03-05-2007, 05:01 AM Re: GSiteCrawler - need some help
Skilled Talker

Posts: 66
Trades: 0
I ran Xenu software on my page, it returned with no broken links. And no I don't have allmost any images that are ment to be words.
__________________

Please login or register to view this content. Registration is FREE
- Find your people Find your party
Please login or register to view this content. Registration is FREE


Please login or register to view this content. Registration is FREE
- Quality free wallpapers
JTGizmo is offline
Reply With Quote
View Public Profile
 
Old 03-05-2007, 05:18 AM Re: GSiteCrawler - need some help
chrishirst's Avatar
Missing! presumed drunk.

Posts: 41,517
Name: Chris Hirst
Location: Blackpool. UK
Trades: 0
Sounds ok then;
How about querystrings or session ID in the URL
Too many querystring parameters can slow down crawling. 2 is ok, 3 is pushing it a bit and 4 or more you will have problems.
Session IDs will eventually cause problems with infinite duplication.
Are all your pages going to be less than 3 clicks away from the home page? If so you need an on-site sitemap in preference to a Google sitemap.

There is this current obsession with Google sitemaps and having to have one. It is not an essential and for the vast majority of sites it will be of no use whatsoever.
__________________
Chris. ->> Links are advertising NOT optimising!! <<-
A foolish consistency is the hobgoblin of little minds
Thought for today:- I SEO the only industry where all the cowboys are Indians?
chrishirst is offline
Reply With Quote
View Public Profile Visit chrishirst's homepage!
 
Old 03-05-2007, 09:42 AM Re: GSiteCrawler - need some help
Skilled Talker

Posts: 66
Trades: 0
if u check my signature u will see my site. Question I have Is - do I just let GSiteCrawler run for certain time to get the sitemap or should I let it finish on its own?

I think I have the problem with '?' and 'id=' - if u check the site u could verify. If that is the problem - then what could I do to fix it? How could I fix it?
__________________

Please login or register to view this content. Registration is FREE
- Find your people Find your party
Please login or register to view this content. Registration is FREE


Please login or register to view this content. Registration is FREE
- Quality free wallpapers
JTGizmo is offline
Reply With Quote
View Public Profile
 
Old 03-06-2007, 07:21 AM Re: GSiteCrawler - need some help
chrishirst's Avatar
Missing! presumed drunk.

Posts: 41,517
Name: Chris Hirst
Location: Blackpool. UK
Trades: 0
Quite honestly, with all those querystring parameters you will have more problems than a Google sitemap will fix.

The script needs recoding or rewrite the URLs and this is the ONLY time and the ONLY reason I would recommend URL rewriting
__________________
Chris. ->> Links are advertising NOT optimising!! <<-
A foolish consistency is the hobgoblin of little minds
Thought for today:- I SEO the only industry where all the cowboys are Indians?
chrishirst is offline
Reply With Quote
View Public Profile Visit chrishirst's homepage!
 
Old 03-06-2007, 10:02 PM Re: GSiteCrawler - need some help
Skilled Talker

Latest Blog Post:
Free PDF Converters
Posts: 76
Trades: 0
Quote:
if u check my signature u will see my site. Question I have Is - do I just let GSiteCrawler run for certain time to get the sitemap or should I let it finish on its own?

I think I have the problem with '?' and 'id=' - if u check the site u could verify. If that is the problem - then what could I do to fix it? How could I fix it?
Let it run. Once it is done, it will inform u.
Or the crawler will just say "idle".
__________________

Please login or register to view this content. Registration is FREE
|
Please login or register to view this content. Registration is FREE
|
Please login or register to view this content. Registration is FREE

Last edited by solidghost; 03-06-2007 at 10:04 PM..
solidghost is offline
Reply With Quote
View Public Profile
 
Reply     « Reply to GSiteCrawler - need some help
 

Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are Off
Pingbacks are Off
Refbacks are Off





   
RSS Feed  Feeds: RSS   JS   XML
RSS Feed  Feeds for this forum: RSS   JS   XML



Page generated in 0.30449 seconds with 12 queries