Google bot and Jetbot has been crawling my site all morning. This is the longest Google has been on my site, its must be crawling every page on the site. anyone know whats going on? I hope it mean PR update is coming soon !!!

Googlebot has been hitting my site for about a week. Seems very active today.

It's been nearly THREE hours and google bot and Jetbot are both still on my site!!!

Originally Posted by bargainsclub

It's been nearly THREE hours and google bot and Jetbot are both still on my site!!!

Wow, that's very nice. All my sites are kind of new and have nearly no ranking.

i need a new site of mine on it :> badly

hi,

I am newbie here, Can u tell me how can I be sure that Some crawlers visited my site today and for how many hours ?

thank you

kashyap

For my site it is easy...Invisionboard has a Bot tracking option so it will show me when the bot is on my site, where it is, and how long it has been active.

Normally you can use your log files and do a search for crawler or robot and get the information that way.

I think I got another bot hitting my site right now, but IPB can not identify it so it is marked as guest....but 9 guests is a lot for me

awstats also separates crawler traffic.

AOL's crawler seems to be very active, but never appears labeled in logs...only as AOL 9.0 etc as if it was a normal user

hi guys, can any body tell me, y google is comming on my site and going without having any thing(pages) in his hands. also my site is not listed on yahoo and msn. my site was there on google for a month (but only index page) y it is sooo. PLEASE help me.....iwantgaurav1 at yahoo.com is my email add..

Google is still crawling my site..It seems to be interested in my forum right now, but I have seen Googlebot on my site for the past 2-3 weeks. Longest I can remember it crawling.

Could anyone tell me how to know when the listings in google have been updated?

is there a way, other than memorizing or recoding somehow what the are now,

then comparing that to later? Also, is there a way to know if you've been banned?


I don't think I deserve it, but that's a bit of a fear of mine, to be honest.

My apologies. This is a double post. Could a mod remove this post, please? Thanks

I wish AWStats had some way to tell me how long the bots have been crawling for.

I assume it'd just be 10 minutes max because it's only a few hundred pages.

Google doesn't do a very good job of indexing IMHO. It has less than half of my pages indexed, and quite a bit less than the actual number of links to my website that it should probably have.

Way to know your banned: your PR is 0 (displays gray on the IE toolbar) and you don't have your website indexed in Google at all.

thanks tntcheats.

They don't send a notice or anything though huh?

Yes that Jetbot has been crawling like mad.

The bloody thing has been sendiing subdomains at me and is getting counted as unique IPs visiting my site - meaning it is screwing up my stats Hopefully it will pay off in visitors eventually.