Groups > Novell > Apache2 for Novell > Webalizer config - here is a bit of help




Webalizer config - here is a bit of help

Webalizer config - here is a bit of help
Sat, 09 Dec 2006 22:37:16 GMT
Hi there

I've created this part of the webalizer to handle agents and 
searchengines, it's based on quite a lot of research, so I hope others 
can benefit from this work as well:
But this one works very well for me on Netware:

# Original file: http://griho.udl.es/webalizer/webalizer.conf.txt

GroupShading    no
GroupHighlight    yes
SearchEngine	348north.com	search=
SearchEngine	abcsearch.com	terms=
SearchEngine	alltheweb.com	q=
SearchEngine	altavista.com	q=
SearchEngine	antisearch.net	KEYWORDS=
SearchEngine	aolsearch	query=
SearchEngine	ask.com	ask=
SearchEngine	ask.co.uk	ask=
SearchEngine	augurnet.ch	q=
SearchEngine	baidu.com	word=
SearchEngine	barrahome.org	query=
SearchEngine	blogdex.net	q=
SearchEngine	blogdigger.com	queryString=
SearchEngine	blogosphere.us	s=
SearchEngine	blogmatrix.com	search=
SearchEngine	blogwise.com	query=
SearchEngine	boitho.com	query=
SearchEngine	buscador.ya.com	q=
SearchEngine	by.com	query=
SearchEngine	daypop.com	q=
SearchEngine	dir.com	req=
SearchEngine	dmoz.org	search=
SearchEngine	dogpile.com	q=
SearchEngine	dpxml	qkw=
SearchEngine	egoto.com	keywords=
SearchEngine	elf8888.at	query0=
SearchEngine	eureka.com	q=
SearchEngine	excite	search=
SearchEngine	feedster.com	q=
SearchEngine	gais.cs.ccu.edu.tw	q=
SearchEngine	galaxy.com	k=
SearchEngine	gigablast.com	q=
SearchEngine	google	q=
SearchEngine	goo.ne.jp	MT=
SearchEngine	hotbot.com	query=
SearchEngine	infoseek.com	qt=
SearchEngine	ixquick.com	query=
SearchEngine	kobala.nl	qr=
SearchEngine	lycos.com	query=
SearchEngine	look.com	q=
SearchEngine	looksmart	key=
SearchEngine	mamma.com	query=
SearchEngine	metacrawler	q=
SearchEngine	msn.com	q=
SearchEngine	msxml	qkw=
SearchEngine	mysearch.com	serachfor=
SearchEngine	naver.com	query=
SearchEngine	netscape.com	query=
SearchEngine	northernlight.com	qr=
SearchEngine	ntlworld.com	q=
SearchEngine	openfind	query=
SearchEngine	overture.com	Keywords=
SearchEngine	picsearch.com	q=
SearchEngine	popdex	query=
SearchEngine	quepasa.com	q=
SearchEngine	search.com	qt=
SearchEngine	searchspider.com	q=
SearchEngine	search.earthlink	q=
SearchEngine	suchmaschine21.de	search=
SearchEngine	syndic8	ShowMatch=
SearchEngine	technorati	query=
SearchEngine	teensearch	query=
SearchEngine	teoma.com	q=
SearchEngine	teradex.com	q=
SearchEngine	texis	q=
SearchEngine	voila	kw=
SearchEngine	walhello	key=
SearchEngine	waypath.com	key=
SearchEngine	webcrawler	searchText=
SearchEngine	webfanatic.lunarpages.com	q=
SearchEngine	whois.sc	q=
SearchEngine	wisenut.com	q=
SearchEngine	yahoo	p=

SearchEngine 348north.com search= 
SearchEngine abacho.de q=  
SearchEngine abcsearch.com terms= 
SearchEngine allesklar.de words= 
SearchEngine alltheweb. query= 
SearchEngine altavista. q= 
SearchEngine antisearch.net KEYWORDS= 
SearchEngine aolsearch query= 
SearchEngine ask.co.uk ask= 
SearchEngine ask.com ask= 
SearchEngine atlas.cz q= 
SearchEngine augurnet.ch q= 
SearchEngine baidu.com word= 
SearchEngine barrahome.org query= 
SearchEngine bbc. q= 
SearchEngine blogdex.net q= 
SearchEngine blogdigger.com queryString= 
SearchEngine blogmatrix.com search= 
SearchEngine blogosphere.us s= 
SearchEngine blogwise.com query= 
SearchEngine boitho.com query= 
SearchEngine btopenworld query= 
SearchEngine buscador.ya.com q= 
SearchEngine by.com query= 
SearchEngine centrum.cz q= 
SearchEngine daypop.com q= 
SearchEngine de.wrs.yahoo.com K= 
SearchEngine dir.com req= 
SearchEngine dmoz.org search= 
SearchEngine dogpile. q= 
SearchEngine dpxml qkw= 
SearchEngine egoto.com keywords= 
SearchEngine elf8888.at query0= 
SearchEngine eureka. q= 
SearchEngine excite search= 
SearchEngine feedster.com q= 
SearchEngine fireball.de q=  
SearchEngine freeserve. q= 
SearchEngine gais.cs.ccu.edu.tw q= 
SearchEngine galaxy.com k= 
SearchEngine gigablast.com q= 
SearchEngine goo.ne.jp MT= 
SearchEngine google q= 
SearchEngine hotbot. MT= 
SearchEngine infoseek. qt= 
SearchEngine iwon searchfor= 
SearchEngine ixquick.com query= 
SearchEngine jyxo.cz s= 
SearchEngine kobala.nl qr= 
SearchEngine look.com q= 
SearchEngine looksmart key= 
SearchEngine lycos. query= 
SearchEngine mamma. query= 
SearchEngine metacrawler q= 
SearchEngine msn. q= 
SearchEngine msxml qkw= 
SearchEngine mysearch.com searchfor= 
SearchEngine naver.com query= 
SearchEngine netscape. search= 
SearchEngine northernlight. qr= 
SearchEngine ntlworld. q= 
SearchEngine openfind query= 
SearchEngine overture. Keywords= 
SearchEngine picsearch.com q= 
SearchEngine popdex query= 
SearchEngine quepasa.com q= 
SearchEngine search. qt= 
SearchEngine search.earthlink q= 
SearchEngine searchspider.com q= 
SearchEngine seznam.cz w= 
SearchEngine suchmaschine21.de search= 
SearchEngine syndic8 ShowMatch= 
SearchEngine technorati query= 
SearchEngine teensearch query= 
SearchEngine teoma q= 
SearchEngine teradex.com q= 
SearchEngine texis q= 
SearchEngine ukplus key= 
SearchEngine voila kw= 
SearchEngine walhello key= 
SearchEngine waypath.com key= 
SearchEngine web.de su=  
SearchEngine webcrawler searchText= 
SearchEngine webfanatic.lunarpages.com q= 
SearchEngine whois.sc q= 
SearchEngine wisenut q= 
SearchEngine wisenut.com q= 
SearchEngine yahoo p= 

MangleAgents 2

GroupAgent Opera/6         Opera 6.x
HideAgent  Opera/6
GroupAgent Opera/5         Opera 5.x
HideAgent  Opera/5
GroupAgent Opera/4         Opera 4.x
HideAgent  Opera/4
GroupAgent Opera/3         Opera 3.x
HideAgent  Opera/3
GroupAgent Netscape/7      Netscape Navigator 7.x
HideAgent  Netscape/7
GroupAgent Netscape6/      Netscape Navigator 6.x
HideAgent  Netscape6/
GroupAgent Mozilla/4       Netscape Navigator 4.x
HideAgent  Mozilla/4
GroupAgent Mozilla/3       Netscape Navigator 3.x
HideAgent  Mozilla/3
GroupAgent MSProxy         Microsoft Proxy
HideAgent  MSProxy
GroupAgent Proxy           Other Proxy software
HideAgent  Proxy
GroupAgent Lynx            Lynx
HideAgent  Lynx
GroupAgent Mozilla/5.0     Moxilla Firefox
HideAgent  Mozilla/5.0
GroupAgent Check&Get       Program: Check&Get (Bookmark Manager) 
GroupAgent Check&Get
GroupAgent eXactSite       Program: eXactSite (HTML authoring.stupid 
user!) 
GroupAgent eXactSite
GroupAgent FavOrg  Program: FavOrg (Bookmark Manager) 
GroupAgent FavOrg
GroupAgent Fetch   Program: Fetch (Offline browser) 
GroupAgent Fetch
GroupAgent GetRight        Program: GetRight (Download Manager) 
GroupAgent GetRight
GroupAgent HTTrack Program: HTTrack (Website Copier) 
HideAgent  HTTrack 
GroupAgent Lachesis        Program: Packet Loss Report (ftp.intel.com) 
HideAgent  Lachesis        
GroupAgent lachesis        Program: Packet Loss Report (ftp.intel.com) 
HideAgent  lachesis        
GroupAgent MSFrontPage     Programming: Microsoft FrontPage (stupid 
user!) 
HideAgent  MSFrontPage     
GroupAgent Offline Program: Offline Explorer (Offline Browser) 
HideAgent  Offline 
GroupAgent Powermarks      Program: Powermarks (Bookmark Manager)
HideAgent  Powermarks      
GroupAgent SuperBot        Program: SuperBot (Web Site Copier) 
HideAgent  SuperBot        
GroupAgent GroupAgent      Teleport        Program: Teleport Pro 
(Offline Browser tenmax.com) 
HideAgent  GroupAgent      
GroupAgent WebStripper     Program: WebStripper (Offline Browser)
HideAgent  WebStripper     
GroupAgent WebZIP  Program: WebZIP (Offline Browser) 
HideAgent  WebZIP  
GroupAgent Alcatel-        Device: Alcatel Mobile Phone 
HideAgent  Alcatel-
GroupAgent AvantGo Device: AvantGo (Offline Browser) 
HideAgent  AvantGo 
GroupAgent Blazer  Device: Blazer (PalmOS browser) 
HideAgent  Blazer  
GroupAgent DoCoMo  Device: I-mode Compatible Mobile Phone 
HideAgent  DoCoMo  
GroupAgent Elaine  Device: Palm browser 
HideAgent  Elaine  
GroupAgent Ericsson        Device: Ericsson Mobile Phone 
HideAgent  Ericsson        
GroupAgent MOT-    Device: Motorola Mobile Phone 
HideAgent  MOT-
GroupAgent jBrowser        Device: WAP Browser jBrowser (built by 
Jataayu) 
HideAgent  jBrowser        
GroupAgent Liberate        Device: Liberate (Digital TV) 
HideAgent  Liberate        
GroupAgent Mitsu   Device: Mitsubishi Mobile Phone 
HideAgent  Mitsu   
GroupAgent Nokia   Device: Nokia Mobile Phone 
HideAgent  Nokia   
GroupAgent Panasonic       Device: Panasonic Mobile Phone 
HideAgent  Panasonic       
GroupAgent PHILIPS-        Device: Philips Mobile Phone 
HideAgent  PHILIPS
GroupAgent SAGEM-  Device: SAGEM Mobile Phone 
HideAgent  SAGEM
GroupAgent SAMSUNG-        Device: Samsung Mobile Phone 
HideAgent  SAMSUNG
GroupAgent SEC-    Device: Samsung Mobile Phone 
HideAgent  SEC-
GroupAgent SHARP-  Device: Sharp Mobile Phone 
HideAgent  SHARP-
GroupAgent SIE-    Device: Siemens Mobile Phone 
HideAgent  SIE-
GroupAgent SonyEricsson    Device: Sony/Ericsson Mobile Phone 
HideAgent  SonyEricsson    
GroupAgent www.wapsilon.com        Device: www.wapsilon.com (WAP 
browser) 
HideAgent  www
GroupAgent WebGo   Device: Offline Browser WebGo (Windows/CE) 
HideAgent  WebGo   
GroupAgent WebTV   Device: WebTV 
HideAgent  WebTV   
GroupAgent AmphetaDesk     RSS: AmphetaDesk 
HideAgent  AmphetaDesk     
GroupAgent Awasu   RSS: Awasu 
HideAgent  Awasu   
GroupAgent FeedDemon       RSS: Feed Demon 
HideAgent  FeedDemon       
GroupAgent Feedreader      RSS: FeedReader 
HideAgent  Feedreader      
GroupAgent FeedOnFeeds     RSS: FeedOnFeeds Reader 
(http://feedonfeeds.com/) 
HideAgent  FeedOnFeeds     
GroupAgent FeedValidator   RSS: Archive.org Feed Validator 
HideAgent  FeedValidator   
GroupAgent MagpieRSS       RSS: MagpieRSS (PHP-based reader) 
HideAgent  MagpieRSS       
GroupAgent MyHeadlines     RSS: MyHeadlines (http://www.jmagar.com/myh4) 
HideAgent  MyHeadlines     
GroupAgent NetNewsWire     RSS: NetNewsWire 
HideAgent  NetNewsWire     
GroupAgent NewsGator       RSS: NewsGator 
HideAgent  NewsGator       
GroupAgent Newz    RSS: Newz Crawler 
HideAgent  Newz    
GroupAgent nntp//rss       RSS: nntp//rss 
(http://www.methodize.org/nntprss/) 
HideAgent  nntp
GroupAgent Radio*  RSS: Radio Userland 
HideAgent  Radio
GroupAgent Oddbot  RSS: OddPost.com 
HideAgent  Oddbot  
GroupAgent PocketFeed      RSS: PocketFeed (Pocket PC RSS reader)
HideAgent  PocketFeed      
GroupAgent PostNuke        RSS: PostNuke CMS 
HideAgent  PostNuke        
GroupAgent SharpReader     RSS: SharpReader 
HideAgent  SharpReader     
GroupAgent Syndigator      RSS: Syndigator 
HideAgent  Syndigator      
GroupAgent Syndirella      RSS: Syndirella 
HideAgent  Syndirella      
GroupAgent UltraLiberalFeedParser  RSS: Ultra Liberal Feed Parser from 
Mark Pilgrim 
HideAgent  UltraLiberalFeedParser  
GroupAgent Wildgrape       RSS: Wildgrape NewsDesk 
HideAgent  Wildgrape       
GroupAgent china   SpamBot: china local browse 2.6 
HideAgent  china   
GroupAgent cloakBrowser    SpamBot: Fantoma 
HideAgent  cloakBrowser    
GroupAgent compatible)     SpamBot: Pretends to be Mozilla 3.0 
HideAgent  compatible
GroupAgent Dattatec.com-Sitios-Top SpamBot: Referrer Spam for 
Dattatec.com 
HideAgent  Dattatec
GroupAgent DTS     SpamBot: Beijing Express Email Address Extractor 
HideAgent  DTS     
GroupAgent EmailSiphon     SpamBot: EmailSiphon 
HideAgent  EmailSiphon     
GroupAgent fantomBrowser   SpamBot: Fantoma 
HideAgent  fantomBrowser   
GroupAgent fantomCrew      SpamBot: Fantoma 
HideAgent  fantomCrew      
GroupAgent Franklin        SpamBot: Franklin Locator 
HideAgent  Franklin        
GroupAgent Finder  SpamBot: Mac Finder 
HideAgent  Finder  
GroupAgent iaea.org        SpamBot: Atomic Harvester 2000 
HideAgent  iaea
GroupAgent Industry        SpamBot: Industry Program 
HideAgent  Industry        
GroupAgent IUFW    SpamBot: IUFW Web 
HideAgent  IUFW    
GroupAgent IUPUI   SpamBot: IUPUI Research Bot 
HideAgent  IUPUI   
GroupAgent Lincoln SpamBot: Lincoln State Web Browser 
HideAgent  Lincoln 
GroupAgent LinkSweeper     SpamBot: LinkSweeper 
HideAgent  LinkSweeper     
GroupAgent Microcomputers  SpamBot: Franklin Locator 
HideAgent  Microcomputers  
GroupAgent Missauga        SpamBot: Missauga Locate 
HideAgent  Missauga        
GroupAgent Missigua        SpamBot: Missauga Locate 
HideAgent  Missigua        
GroupAgent NationalDirectory       Spambot: National Directory Email 
Harvester 
HideAgent  NationalDirectory       
GroupAgent Rainbow SpamBot: Under the Rainbow 
HideAgent  Rainbow 
GroupAgent Shareware       Spambot: Program Shareware 
HideAgent  Shareware       
GroupAgent stealthBrowser  Spambot: Fantoma 
HideAgent  stealthBrowser  
GroupAgent Sweeper Spambot: Mail Sweeper 
HideAgent  Sweeper 
GroupAgent WEP     SpamBot: WEP Search 
HideAgent  WEP     
GroupAgent Xenu    SpamBot: Xenu 
HideAgent  Xenu    
GroupAgent 348NorthNews    Spider: 348north.com 
HideAgent  348NorthNews    
GroupAgent almaden.ibm.com/cs/crawler      Spider: almaden.ibm.com 
HideAgent  almaden
GroupAgent antibot Spider: Antidot.net 
http://www.antidot.net/Welcome/jsp/robots.html 
HideAgent  antibot 
GroupAgent http://Ask.24x.Info/    Spider: MnogoSearch.org 
HideAgent  http
GroupAgent ASPseek Spider: ASPseek.org free search engine software 
HideAgent  ASPseek 
GroupAgent aspseek Spider: ASPseek.org free search engine software 
HideAgent  aspseek 
GroupAgent augurfind       Spider: augurnet.ch (Swiss Search Engine) 
HideAgent  augurfind       
GroupAgent Baiduspider     Spider: Baidu.com 
HideAgent  Baiduspider     
GroupAgent BarraHomeCrawler        Spider: Barrahome.org 
HideAgent  BarraHomeCrawler        
GroupAgent BBot    Spider: http://www.otthon.net/search/ 
HideAgent  BBot    
GroupAgent Bilbo   Spider: wise-guys.nl 
HideAgent  Bilbo   
GroupAgent blo.gs  Spider: blo.gs 
HideAgent  blo.gs
GroupAgent BlogBot Spider: Blogdex.net 
HidepAgent Blogosphere     Spider: Blogosphere.us 
GroupAgent BlogPulse       Spider: Blogpulse.com 
HideAgent  BlogPulse       
GroupAgent BlogShares      Spider: BlogShares.com 
HideAgent  BlogShares      
GroupAgent Blogwise.com    Spider: Blogwise.com 
HideAgent  Blogwise
GroupAgent boitho.com      Spider: boitho.com 
HideAgent  boitho.com
GroupAgent bookwatch@onfocus.com   Spider: OnFocus.com Weblog BookWatch 
HideAgent  bookwatch@onfocus.com
GroupAgent brainoff.com/geoblog/   Spider: The World as a Blog 
(brainoff.com/geoblog/) 
HideAgent  brainoff/geoblog/
GroupAgent www.business-socket.com Spider: www.business-socket.com 
HideAgent  www.business-socket.com
GroupAgent CJNetworkQuality        Spider: CommissionJunction.com
HideAgent  CJNetworkQuality        
GroupAgent combine Spider: http://www.lub.lu.se/combine/ 
HideAgent  combine 
GroupAgent COMBINE Spider: http://www.lub.lu.se/combine/ 
HideAgent  COMBINE 
GroupAgent CoolBot Spider: www.suchmaschine21.de (German Search Engine) 
HideAgent  CoolBot 
GroupAgent CoologFeedSpider        Spider: CoolLog 
http://www.webfanatic.lunarpages.com/coolog/ 
HideAgent  CoologFeedSpider        
GroupAgent CopyHunter      Spider: AWstats referrer log analyzer 
HideAgent  CopyHunter      
GroupAgent daypopbot Spider: DayPop.com 
HideAgent  daypopbot 
GroupAgent Ecosystem/development   Spider: Blogging Ecosystem 
HideAgent  Ecosystem/development
GroupAgent EgotoBot        Spider: Egoto.com 
HideAgent  EgotoBot        
GroupAgent ETS     Spider: Freetranslation.com 
HideAgent  ETS     
GroupAgent exactseek.com   Spider: exactseek.com 
HideAgent  exactseek.com
GroupAgent Exalead Spider: Exalead.com (AOL France) 
HideAgent  Exalead 
GroupAgent FAST    Spider: All The Web 
HideAgent  FAST    
GroupAgent Fast    Spider: All The Web 
HideAgent  Fast    
GroupAgent Feedster        Spider: Feedster.com 
HideAgent  Feedster        
GroupAgent FlickBot        Spider: DivX Networks FlickBot 
HideAgent  FlickBot        
GroupAgent Gaisbot Spider: GAIS (http://gais.cs.ccu.edu.tw/ ) 
HideAgent  Gaisbot 
GroupAgent GalaxyBot       Spider: Galaxy.com 
HideAgent  GalaxyBot       
GroupAgent Genome  Spider: Waypath.com 
HideAgent  Genome  
GroupAgent Gigabot Spider: Gigablast.com 
HideAgent  Gigabot 
GroupAgent Google* Spider: Google.com  
HideAgent  Google
GroupAgent msnbot          Spider: MSN
HideAgent  msnbot
GroupAgent gossamer-threads.com    Spider: Links SQL 
HideAgent  gossamer
GroupAgent grub-client     Spider: Grub.org 
HideAgent  grub
GroupAgent htdig   Spider: htdig (Open Source Search Engine) 
HideAgent  htdig   
GroupAgent ia_archiver     Spider: Archive.org 
HideAgent  ia_archiver
GroupAgent INGRID/3.0      Spider: ilse.nl (Dutch search engine) 
HideAgent  INGRID/3.0
GroupAgent InternetSeer    Spider: InternetSeer.com (Web Site 
Monitoring) 
HideAgent  InternetSeer    
GroupAgent internetseer    Spider: InternetSeer.com (Web Site 
Monitoring) 
HideAgent  internetseer    
GroupAgent IXE     Spider: ideare.com 
HideAgent  IXE     
GroupAgent janes-blogosphere       Spider: BlogMatrix.com 
HideAgent  janes-blogosphere
GroupAgent jiffe   Spider: jiffe.com 
HideAgent  jiffe   
GroupAgent k2spider        Spider: Verity Spider 
HideAgent  k2spider        
GroupAgent larbin  Spider: larbin 
(http://sourceforge.net/projects/larbin/) 
HideAgent  larbin  
GroupAgent Leknor.com      Spider: Leknor.com GZIP Tester 
HideAgent  Leknor
GroupAgent Linkbot Spider: Linkbot link monitoring tool (Watchfire.com) 
HideAgent  Linkbot 
GroupAgent LinkHype        Spider: LinkHype.com 
HideAgent  LinkHype        
GroupAgent LinksManager.com        Spider: LinksManager.com 
HideAgent  LinksManager
GroupAgent LinkWalker      Spider: seventwentyfour.com 
HideAgent  LinkWalker      
GroupAgent LNSpiderguy     Spider: Lexis-Nexis 
HideAgent  LNSpiderguy     
GroupAgent MnogoSearch     Spider: MnogoSearch.org 
HideAgent  MnogoSearch     
GroupAgent mogimogi        Spider: www.goo.ne.jp (Japanese Search 
Engine) 
HideAgent  mogimogi        
GroupAgent MSNBOT  Spider: MSN.com 
HideAgent  MSNBOT  
GroupAgent MyWireServiceBot        Spider: MyWireService.com 
HideAgent  MyWireServiceBot        
GroupAgent NaverRobot      Spider: Naver.com (Korean Search Engine) 
HideAgent  NaverRobot      
GroupAgent Netcraft        Spider: Netcraft Web Survey 
HideAgent  Netcraft        
GroupAgent NetResearchServer       Spider: Look.com 
HideAgent  NetResearchServer       
GroupAgent NIF     Spider: Newsisfree.com 
HideAgent  NIF     
GroupAgent NG/1.0  Spider: Exalead.com (AOL France) 
HideAgent  NG/1.0
GroupAgent NITLE   Spider: Blogcensus.net 
HideAgent  NITLE   
GroupAgent NPBot   Spider: NameProtect.com 
HideAgent  NPBot   
GroupAgent NRK-bruker      Spider: NRK.no 
HideAgent  NRK-bruker
GroupAgent Openbot Spider: OpenFind (http://www.openfind.com.tw/)
HideAgent  Openbot 
GroupAgent Pompos  Spider: Dir.com 
HideAgent  Pompos  
GroupAgent Popdexter       Spider: Popdex.com 
HideAgent  Popdexter       
GroupAgent psbot   Spider: Picsearch.com 
HideAgent  psbot   
GroupAgent QuepasaCreep    Spider: Quepasa.com (Spanish site) 
HideAgent  QuepasaCreep    
GroupAgent Robozilla       Spider: Link Checker for Dmoz.org 
HideAgent  Robozilla       
GroupAgent Scooter Spider: Altavista 
HideAgent  Scooter 
GroupAgent searchspider.com        Spider: searchspider.com 
HideAgent  searchspider
GroupAgent semanticdiscovery       Spider: semanticdiscovery.com 
HideAgent  semanticdiscovery       
GroupAgent SideWinder      Spider: Infoseek 
HideAgent  SideWinder      
GroupAgent slurp@inktomi.com       Spider: Inktomi 
HideAgent  slurp
GroupAgent spider@spider.ilab.sztaki.hu    Spider: 
http://www.ilab.sztaki.hu/websearch/ 
HideAgent  spider
GroupAgent Spinne  Spider: webauskunft.at 
HideAgent  Spinne  
GroupAgent Steeler Spider: Kitsuregawa Laboratory, The University of 
Tokyo 
HideAgent  Steeler 
GroupAgent SurveyBot       Spider: whois.sc 
HideAgent  SurveyBot       
GroupAgent Syndic8 Spider: Syndic8 
HideAgent  Syndic8 
GroupAgent Tagword Spider: Tagword - http://tagword.com/dmoz_survey.php 
HideAgent  Tagword 
GroupAgent Teoma   Spider: Teoma  
HideAgent  Teoma   
GroupAgent Teradex Spider: Teradex.com (directory) 
HideAgent  Teradex 
GroupAgent Terrar  Spider:  Terrar (http://www.terrar.com) 
HideAgent  Terrar  
GroupAgent Technoratibot Spider: Technorati 
HideAgent  Technoratibot 
GroupAgent THUNDERSTONE Spider: Webinator 
(http://www.thunderstone.com/texis/site/pages/webinator.html) 
HideAgent  THUNDERSTONE 
GroupAgent timboBot        Spider: BreakingBlogs.com 
HideAgent  timboBot        
GroupAgent TurnitinBot     Spider: Turnitin.com 
HideAgent  TurnitinBot     
GroupAgent http://www.tutorgig.com/        Spider: tutorgig.com 
HideAgent  http
GroupAgent Vagabondo       Spider: kobala.nl 
HideAgent  Vagabondo       
GroupAgent verzamelgids    Spider: verzamelgids.nl 
HideAgent  verzamelgids    
GroupAgent VoilaBot        Spider: Voila.com 
HideAgent  VoilaBot        
GroupAgent W3C_Validator   Spider: W3C Validator 
HideAgent  W3C
GroupAgent www.walhello.com        Spider: Walhello.com 
HideAgent  www.walhello.com
GroupAgent WebCapture      Spider: WebCapture.biz 
HideAgent  WebCapture      
GroupAgent Webclipping     Spider: Webclipping.com 
HideAgent  Webclipping     
GroupAgent WebFilter       Spider: http://www.ils.unc.edu/webfilter/ 
HideAgent  WebFilter       
GroupAgent WebGather       Spider: City Polytechnic of Hong Kong 
HideAgent  WebGather       
GroupAgent WebRACE Spider: WebRACE (University of Cyprus, Distributed 
Crawler) 
HideAgent  WebRACE 
GroupAgent websitealert.net        Spider: websitealert.net (Monitoring 
System) 
HideAgent  websitealert
GroupAgent Zealbot Spider: Looksmart.com 
HideAgent  Zealbot 
GroupAgent ZyBorg  Spider: WiseNut.com 
HideAgent  ZyBorg  
GroupAgent curl    Programming: curl library (PHP) 
HideAgent  curl    
GroupAgent Indy    Programming: Indy (Delphi-based client) 
HideAgent  Indy    
GroupAgent Java    Programming: Java-based client 
HideAgent  Java    
GroupAgent Jakarta Programming: Jakarta (Java) 
HideAgent  Jakarta 
GroupAgent libwww-perl     Programming: LIB-WWW (Perl library) 
HideAgent  libwww-perl
GroupAgent LWP:    Pogramming: LWP: : Simple (Perl library) 
HideAgent  LWP:
GroupAgent OPWV-SDK        Programming: OpenWave Mobile Development SDK 
HideAgent  OPWV-SDK
GroupAgent PEAR    Programming: PEAR Library (PHP) 
HideAgent  PEAR    
GroupAgent PHP     Programming: PHP-based client 
HideAgent  PHP     
GroupAgent Python-urllib   Programming: URLLIB (Python library) 
HideAgent  Python-urllib
GroupAgent rdflib  Programming: rdflib (Python RDF library) 
HideAgent  rdflib  
GroupAgent RPT-HTTPClient  Programming: RPT-HTTP (Java) 
HideAgent  RPT-HTTPClient
GroupAgent Snoopy  Programming: Snoopy (PHP class - 
http://snoopy.sourceforge.net/ ) 
HideAgent  Snoopy  
GroupAgent SOFTWING_TEAR_AGENT     Programming: Softwing Tear Agent 
(Active Server Pages) 
HideAgent  SOFTWING_TEAR_AGENT
GroupAgent Wget    Programming: Wget library 
(http://www.gnu.org/software/wget/wget.html) 
HideAgent  Wget    
GroupAgent WinHttp.WinHttpRequest  Program: WinHttp.WinHttpRequest 
library (Visual Basic) 
HideAgent  WinHttp
GroupAgent Bison   Proxy: Proxomitron (Proxomitron.info) 
HideAgent  Bison   
GroupAgent BorderManager   Proxy Novell Border Manager Security Suite 
HideAgent  BorderManager   
GroupAgent CE-Preload      Proxy: Cisco Content Engine 
HideAgent  CE
GroupAgent DA      Proxy: DA 
HideAgent  DA      
GroupAgent junkbuster      Proxy: junkbuster (junkbusters.com) 
HideAgent  junkbuster      
GroupAgent AppleWebKit     Safari (OSX) 
HideAgent  AppleWebKit     
GroupAgent BFS_method      BeOS browser 
HideAgent  BFS
GroupAgent Camino  Mozilla-based browser Camino (OSX) 
HideAgent  Camino  
GroupAgent iCab    iCab (Mac) 
HideAgent  iCab    
GroupAgent Links   Links (Text-based browser) 
HideAgent  Links   
GroupAgent Lynx*   Lynx    (Text-based browser) 
HideAgent  Lynx
GroupAgent NCBrowser       NCBrowser (RISC OS) 
HidepAgent Opera   Opera 
GroupAgent SlimBrowser     SlimBrowser 
(http://www.flashpeak.com/sbrowser/sbrowser.htm) 
HideAgent  SlimBrowser     
GroupAgent w3m     w3m (Text-based browser - http://w3m.sourceforge.net/ 
) 
HideAgent  w3m     
GroupAgent Yahoo           Spider: Yahoo
HideAgent  Yahoo           
GroupAgent 4.01    Internet Explorer 4.01 
HideAgent  4.01
GroupAgent 5.01    Internet Explorer 5.01 
HideAgent  5.01
GroupAgent 5.0     Internet Explorer 5.0 
HideAgent  5.0
GroupAgent 5.2    Internet Explorer 5.2 (Mac) 
HideAgent  5.2
GroupAgent 5.1    Internet Explorer 5.1 (Mac) 
HideAgent  5.1
GroupAgent 5.5     Internet Explorer 5.5 (Windows) 
HideAgent  5.5
GroupAgent 6.0     Internet Explorer 6.0 (Windows) 
HideAgent  6.0
GroupAgent 7.0     Internet Explorer 7.0 (Windows) 
HideAgent  7.0
GroupAgent Mozilla/3.04Gold        Netscape 3.04 Gold 
HideAgent  Mozilla/3.04Gold
GroupAgent Mozilla/4.04    Netscape 4
HideAgent  Mozilla/4.04
GroupAgent Mozilla/4.06    Netscape 4 
HideAgent  Mozilla/4.06
GroupAgent Mozilla/4.08    Netscape 4 
HideAgent  Mozilla/4.08
GroupAgent Mozilla/4.5     Netscape 4.5 
HideAgent  Mozilla/4.5
GroupAgent Mozilla/4.7     Netscape 4.7 
HideAgent  Mozilla/4.7
GroupAgent Mozilla/4.8     Netscape 4.8 
HideAgent  Mozilla/4.8
GroupAgent Konqueror       KDE Konqueror (Linux)
HideAgent  Konqueror
GroupAgent ichiro          Spider: Ichiro (Japanese)
HideAgent  ichiro
GroupAgent www.adressendeutschland.de  Spider: Adressen Deutchland 
(German)
Post Reply
about | contact