Tycoon Talk
Become a Big fish!
The number 1 forum for online business!
Post topics, ask questions, share your knowledge.
Tycoon Talk is part of Freelancer.com - find skilled workers online at a fraction of the cost.

The Google Forum


You are currently viewing our The Google Forum as a guest. Please register to participate.
Login



Reply
How Networks (such as IMDT.biz) Affect PageRank
Old 11-01-2004, 01:32 AM
nick89's Avatar
Super Talker

Posts: 136
Location: Brisbane, Australia
Trades: 0
The following uses all the latest known active user agents which can be found here. If you only want to be friendly to google and inktomi for example you can simply limit the list to them

PHP Code:
<?php
$user_agents 
= array('ABCdatos BotLink''Acme.Spider''Ahoy! The Homepage Finder''Alkaline''Anthill''Walhello appie''Arachnophilia''Arale''Araneo''AraybOt''ArchitextSpider''Aretha''ARIADNE''arks''ASpider (Associative Spider)''ATN Worldwide''Atomz.com Search Robot''AURESYS''BackRub''unnamed''BBot''Big Brother''Bjaaland''BlackWidow''Die Blinde Kuh''Bloodhound''Borg-Bot''BoxSeaBot''bright.net caching robot''BSpider''CACTVS Chemistry Spider''Calif''Cassandra''Digimarc Marcspider/CGI''Checkbot''ChristCrawler.com''churl''cIeNcIaFiCcIoN.nEt''CMC/0.01''Collective''Combine System''ConfuzzledBot''CoolBot''Web Core / Roots''XYLEME Robot''Internet Cruiser Robot''Cusco''CyberSpyder Link Test''CydralSpider''Desert Realm Spider''DeWeb(c) Katalog/Index''DienstSpider''Digger''Digital Integrity Robot''Direct Hit Grabber''DNAbot''DownLoad Express''DragonBot''DWCP (Dridus' Web Cataloging Project)', 'e-collector', 'EbiNess', 'EIT Link Verifier Robot', 'ELFINBOT', 'Emacs-w3 Search Engine', 'ananzi', 'esculapio', 'Esther', 'Evliya Celebi', 'nzexplorer', 'FastCrawler', 'Fluid Dynamics Search Engine robot', 'Felix IDE', 'Wild Ferret Web Hopper #1', '#2', '#3', 'FetchRover', 'fido', 'Hämähäkki', 'KIT-Fireball', 'Fish search', 'Fouineur', 'Robot Francoroute', 'Freecrawl', 'FunnelWeb', 'gammaSpider', 'FocusedCrawler', 'gazz', 'GCreep', 'GetBot', 'GetURL', 'Golem', 'Googlebot', 'Grapnel/0.01 Experiment', 'Griffon', 'Gromit', 'Northern Light Gulliver', 'Gulper Bot', 'HamBot', 'Harvest', 'havIndex', 'HI (HTML Index) Search', 'Hometown Spider Pro', 'Wired Digital', 'ht://Dig', 'HTMLgobble', 'Hyper-Decontextualizer', 'iajaBot', 'IBM_Planetwide', 'Popular Iconoclast', 'Ingrid', 'Imagelock', 'IncyWincy', 'Informant', 'InfoSeek Robot 1.0', 'Infoseek Sidewinder', 'InfoSpiders', 'Inspector Web', 'IntelliAgent', 'I', 'Robot', 'Iron33', 'Israeli-search', 'JavaBee', 'JBot Java Web Robot', 'JCrawler', 'AskJeeves', 'JoBo Java Web Robot', 'Jobot', 'JoeBot', 'The Jubii Indexing Robot', 'JumpStation', 'image.kapsi.net', 'Katipo', 'KDD-Explorer', 'Kilroy', 'KO_Yappo_Robot', 'LabelGrabber', 'larbin', 'legs', 'Link Validator', 'LinkScan', 'LinkWalker', 'Lockon', 'logo.gif Crawler', 'Lycos', 'Mac WWWWorm', 'Magpie', 'marvin/infoseek', 'Mattie', 'MediaFox', 'MerzScope', 'NEC-MeshExplorer', 'MindCrawler', 'mnoGoSearch search engine software', 'moget', 'MOMspider', 'Monster', 'Motor', 'MSNBot', 'Muncher', 'Muninn', 'Muscat Ferret', 'Mwd.Search', 'Internet Shinchakubin', 'NDSpider', 'NetCarta WebMap Engine', 'NetMechanic', 'NetScoop', 'newscan-online', 'NHSE Web Forager', 'Nomad', 'The NorthStar Robot', 'ObjectsSearch', 'Occam', 'HKU WWW Octopus', 'OntoSpider', 'Openfind data gatherer', 'Orb Search', 'Pack Rat', 'PageBoy', 'ParaSite', 'Patric', 'pegasus', 'The Peregrinator', 'PerlCrawler 1.0', 'Phantom', 'PhpDig', 'PiltdownMan', 'Pimptrain.com's robot', 'Pioneer', 'html_analyzer', 'Portal Juice Spider', 'PGP Key Agent', 'PlumtreeWebAccessor', 'Poppi', 'PortalB Spider', 'psbot', 'GetterroboPlus Puu', 'The Python Robot', 'Raven Search', 'RBSE Spider', 'Resume Robot', 'RoadHouse Crawling System', 'RixBot', 'Road Runner: The ImageScape Robot', 'Robbie the Robot', 'ComputingSite Robi/1.0', 'RoboCrawl Spider', 'RoboFox', 'Robozilla', 'Roverbot', 'RuLeS', 'SafetyNet Robot', 'Scooter', 'Search.Aus-AU.COM', 'Sleek', 'SearchProcess', 'Senrigan', 'SG-Scout', 'ShagSeeker', 'Shai'Hulud', 'Sift', 'Simmany Robot Ver1.0', 'Site Valet', 'SiteTech-Rover', 'Skymob.com', 'SLCrawler', 'Inktomi Slurp', 'Smart Spider', 'Snooper', 'Solbot', 'Speedy Spider', 'spider_monkey', 'SpiderBot', 'Spiderline Crawler', 'SpiderMan', 'SpiderView(tm)', 'Spry Wizard Robot', 'Site Searcher', 'Suke', 'suntek search engine', 'Sven', 'Sygol', 'TACH Black Widow', 'Tarantula', 'tarspider', 'Tcl W3 Robot', 'TechBOT', 'Templeton', 'TitIn', 'TITAN', 'The TkWWW Robot', 'TLSpider', 'UCSD Crawl', 'UdmSearch', 'UptimeBot', 'URL Check', 'URL Spider Pro', 'Valkyrie', 'Verticrawl', 'Victoria', 'vision-search', 'void-bot', 'Voyager', 'VWbot', 'The NWI Robot', 'W3M2', 'WallPaper (alias crawlpaper)', 'the World Wide Web Wanderer', 'w@pSpider by wap4.com', 'WebBandit Web Spider', 'WebCatcher', 'WebCopy', 'webfetcher', 'The Webfoot Robot', 'Webinator', 'weblayers', 'WebLinker', 'WebMirror', 'The Web Moose', 'WebQuest', 'Digimarc MarcSpider', 'WebReaper', 'webs', 'Websnarf', 'WebSpider', 'WebVac', 'webwalk', 'WebWalker', 'WebWatch', 'Wget', 'whatUseek Winona', 'WhoWhere Robot', 'Weblog Monitor', 'w3mir', 'WebStolperer', 'The Web Wombat', 'The World Wide Web Worm', 'WWWC Ver 0.2.5', 'WebZinger', 'XGET', 'Nederland.zoek');
$bot FALSE;
foreach(
$user_agents as $the_agent){
  if(
$_SERVER['HTTP_USER_AGENT']; = $the_agent){
    
$bot TRUE;
  }
}
if(!
bot){
  
//dropdown menu
}else{
  
//bot friendly menu
}
?>
nick89 is offline
Reply With Quote
View Public Profile Visit nick89's homepage!
 
 
Register now for full access!
Old 11-01-2004, 07:18 AM
DevelopedWeb's Avatar
Webmaster Talker

Posts: 610
Location: USA
Trades: 0
That looks very useful... now I just have to get all the non-PHP sites on my network to convert over so I can use it.
__________________
DevelopedWeb.com -
Please login or register to view this content. Registration is FREE


Please login or register to view this content. Registration is FREE
- a brand new online discussion area.
DevelopedWeb is offline
Reply With Quote
View Public Profile Visit DevelopedWeb's homepage!
 
Old 11-01-2004, 07:56 AM
Skilled Talker

Posts: 74
Location: .au/.sg
Trades: 0
Frankly, I don't recommend using that PHP script (by nick89), it's cloaking (http://www.google.com/webmasters/faq.html#cloaking).

Using the <noscript> tag, or add a link from every sites of yours to a main site and from there link back to them will be better.
__________________
@

Please login or register to view this content. Registration is FREE
|
Please login or register to view this content. Registration is FREE
|
Please login or register to view this content. Registration is FREE

-
Please login or register to view this content. Registration is FREE
alien is offline
Reply With Quote
View Public Profile
 
Reply     « Reply to How Networks (such as IMDT.biz) Affect PageRank

Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are Off
Pingbacks are Off
Refbacks are Off





   
RSS Feed  Feeds: RSS   JS   XML
RSS Feed  Feeds for this forum: RSS   JS   XML



Page generated in 0.11864 seconds with 11 queries