My script adds information to a database everytime the page is loaded, IP, time, date, referer etc. Kind of like a counter.

I keep getting IP addresses that are search engine spiders, I currently manually add their IP to a line which then doesn't add that IP's info to the database. Although the amount of spiders are increasing and manually is taking to long, is there a way to stop ALL spider's IPs from adding to the database automatically?

I understand that if a spider runs your script you get an IP... so, check if there is a human

what do u mean, both humans and robots adds to the database

I'm pretty sure there are bot lists floating around.

Originally Posted by Gilligan

I keep getting IP addresses that are search engine spiders, I currently manually add their IP to a line which then doesn't add that IP's info to the database. Although the amount of spiders are increasing and manually is taking to long, is there a way to stop ALL spider's IPs from adding to the database automatically?

User agent string?

unsure of what that is..care to elaborate?

Try taking a look at these:

http://www.useragentstring.com/pages...gentstring.php
http://www.texsoft.it/index.php?c=so...useragent&l=it

This might help:
http://www.webmaster-talk.com/php-fo...tml#post525177

so if i just do

PHP Code:

 <?php
  
  $user_agent = strtolower($_SERVER['HTTP_USER_AGENT']);
    
   if (!empty($user_agent))
   {
     // stuff for spider here ??
   }
   
   else 
   {
     // stuff for human here ??
   }
  
?>

Originally Posted by Gilligan

so if i just do

PHP Code:

 <?php
  
  $user_agent = strtolower($_SERVER['HTTP_USER_AGENT']);
    
   if (!empty($user_agent))
   {
     // stuff for spider here ??
   }
   
   else 
   {
     // stuff for human here ??
   }
  
?>

Not quite. Both bots and humans are going to have user agents. What you'll have to do instead is check the user agent against a list of bots. If it matches, don't add it to the database; if it doesn't match, add it to the database. One way, and I'm not sure if it's the most efficient way, to check for this is by using regular expressions to compare the bot name against the user agent. As an example:

PHP Code:

if ((eregi("google", $user_agent)) {
     //A bot, don't add
} else {
     //A human, add
} 


so there's no general code for all robots.

like

PHP Code:

$ip = getenv(REMOTE_ADDR);

if ($ip != a spider / crwaler) {

// add to database

} 


Not that I know, but if you find one, I'd love to know. The closest thing you might be able to do is check for the word 'bot'. Even that, though, will let a lot of bots past because there are many that don't have that in their name.