Tycoon Talk
Become a Big fish!
The number 1 forum for online business!
Post topics, ask questions, share your knowledge.
Tycoon Talk is part of Freelancer.com - find skilled workers online at a fraction of the cost.

The Google Forum


You are currently viewing our The Google Forum as a guest. Please register to participate.
Login



Reply
Old 09-05-2004, 03:52 PM Bots wont follow
airiox's Avatar
Novice Talker

Posts: 6
Trades: 0
Okay here is my website. http://www.airiox.com/

Its not quite done yet but the problem I have is that The google bot wont follow any of my links. I eventually submited my main pages individually.

Does anyone know why?

Here is what my robots.txt file looks like.

User-Agent: *
Disallow: /cgi-bin/
Disallow: /images/


Here is what my meta's look like.

<meta http-equiv="Content-Type" content="text/html; charset=iso-8859-1">
<meta name="keywords" content="reviews, pc games, computer hardware, anime, torrents, reviews, tech news, computer news, tech forum, game forum, anime forum, forum ">
<meta name="description" content="airiox.com - in depth reviews of computer and anime related stuff">
<meta name="revisit-after" content="1">
<meta name="refresh" content="30">
<meta name="robots"content="index,follow">

anyone who is smart can you please help me?
airiox is offline
Reply With Quote
View Public Profile
 
 
Register now for full access!
Old 09-06-2004, 10:52 PM
Junior Talker

Posts: 4
Trades: 0
I always do it this way:

User-Agent: *
Disallow: /cgi-bin/
Disallow: /images/
Disallow:


The last disallow tells the robots all is ok after the diallowed directories,

always works for me, but I never leave the last disallow out.
danz is offline
Reply With Quote
View Public Profile
 
Old 09-24-2004, 10:20 PM
airiox's Avatar
Novice Talker

Posts: 6
Trades: 0
any other ideas they still dont seem to be following. It just stops by the pages i submited and doesnt archive anything else. The adsense bots seem to work fine though.
airiox is offline
Reply With Quote
View Public Profile
 
Old 09-24-2004, 10:40 PM
vivekar's Avatar
Webmaster Talker

Posts: 612
Trades: 0
How do you know that Bots are not following?

They do follow.

You have 13 pages listed with google.
If your website is fresh, It takes some time for G to visit all your pages.
__________________

Please login or register to view this content. Registration is FREE
(Active since 2003) |
Please login or register to view this content. Registration is FREE
vivekar is offline
Reply With Quote
View Public Profile Visit vivekar's homepage!
 
Old 09-26-2004, 02:24 PM
airiox's Avatar
Novice Talker

Posts: 6
Trades: 0
Well that is becuase I have submited all those pages individually to google. I dont want to submit everypage indivdually. I would just like it to follow.
airiox is offline
Reply With Quote
View Public Profile
 
Old 09-28-2004, 03:48 AM
kashyap_rajput's Avatar
Skilled Talker

Posts: 78
Location: India
Trades: 0
Its good idea to submit domain only, all pages submission might trap you as spammers, and keep all other stuff of allow/disallow in spiders.txt ...

kashyap
__________________

Please login or register to view this content. Registration is FREE


Please login or register to view this content. Registration is FREE
kashyap_rajput is offline
Reply With Quote
View Public Profile Visit kashyap_rajput's homepage!
 
Old 09-28-2004, 09:09 PM
vivekar's Avatar
Webmaster Talker

Posts: 612
Trades: 0
You don't have to submit individual pages to Google. It will find it on its own.

The reason Google is not finding your website is that you have a meagre backlinks.
Get some backlinks from other related websites.
G will find you and index more content.

Hope this helps.
__________________

Please login or register to view this content. Registration is FREE
(Active since 2003) |
Please login or register to view this content. Registration is FREE
vivekar is offline
Reply With Quote
View Public Profile Visit vivekar's homepage!
 
Old 09-29-2004, 01:46 AM
airiox's Avatar
Novice Talker

Posts: 6
Trades: 0
It visits my site like every two weeks. Shouldnt it still follow?
airiox is offline
Reply With Quote
View Public Profile
 
Reply     « Reply to Bots wont follow
 

Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are Off
Pingbacks are Off
Refbacks are Off





   
RSS Feed  Feeds: RSS   JS   XML
RSS Feed  Feeds for this forum: RSS   JS   XML



Page generated in 1.01152 seconds with 12 queries