I own a website www.BxMag.com . It is an Articles and free content site. Google has sent the crawler twice since launching. However, although it crawls the main page, it wont crawl any of the articles. Any help will be greatly appreciated.

The url again is www.bxmag.com

Google and most search engines cannot comprehend anything after the "?" in the URL. I've solved this problem by using a RSS parsar (if your site outputs the links that way) and recreating the homepage and linking to the articles with an rss parsar. I like your site.

Thanks. Yeah I thought about that. However, I have another site www.InnRentals.com which uses the ? (query string), and google has indexed everysingle page.

I don't know much about it to have a clue why it would index some and not others. But I have a website where I have the news links added by a parsar instead of the regular phpnuke page, and google indexes all those pages.

clientcenters: when did you submit your site, and long after that did google crawl the index page of your site?

Originally Posted by methodman

clientcenters: when did you submit your site, and long after that did google crawl the index page of your site?

dont waste your time submiting your site, that is useless, you need to get links from other sites! this is the most important thing, then you will see your site getting more deeply crawled. also make sure the links have your keywords as anchor text, this is also important.

what do you type at google again to check the back links to your site?

link:www.site.com

Originally Posted by ewokforhire

dont waste your time submiting your site, that is useless, you need to get links from other sites! this is the most important thing, then you will see your site getting more deeply crawled. also make sure the links have your keywords as anchor text, this is also important.

Submitting your site is a waste of time?

What do you base this theory on, I'm curious?

Links do not help you get crawled, unless the link is pointing to the pages getting crawled. Links help PR, which helps the overall importance of the site.

As for the original question, I agree with whoever said Google finds it hard to crawl URL's like http://www.mydomain.com?blah=blah&this=that.

A solution I use is mod_rewrite, which makes URL's for SE friendly. My site's are mostly made up of those nasty looking URL's, but using mod_rewrite, to YOU and the SE's, they appear as html files.

Do a search on Google for tips on mod_rewrite.

If the site is new, google may have not done a deep crawl yet. With some backlinks and time, the googlebot should crawl through more of the pages.

Google and most search engines cannot comprehend anything after the "?" in the URL.

i beg to differ, google has probably always recognized it, and others usually do. There are reports of it being better to use individual pages however.

Originally Posted by accesstimes

i beg to differ, google has probably always recognized it, and others usually do. There are reports of it being better to use individual pages however.

I agree. After using mod_rewrite to clean up the ugly URL's on my site, Google has been A LOT busier crawling my site.

Thanks everyone. I certainly see that I have some work to do.