homepage Welcome to WebmasterWorld Guest from 107.22.37.143
register, free tools, login, search, subscribe, help, library, announcements, recent posts, open posts,
Pubcon Website
Visit PubCon.com
Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification

Search Engine Spider and User Agent Identification

Forum Charter, Library, Moderated by: Ocean10000 & incrediBILL Forum Options: Reset Last Read Pointers

PreModerated forum to id search engine spiders

 
new Subject Messages Started by Last Message
newpost thread iconAnybody know this one?
  User-Agent: Mozilla/5.0 URL-Spider
2volatilegx 8:17 pm on Apr 4, 2001 (gmt 0)
newpost thread iconeSense (Chimera)
  Mozzila/4.0 (Compatible); www.vigil.com/esensedisclaim.html
9mattur 1:42 pm on Apr 4, 2001 (gmt 0)
newpost thread iconFreaky spiders
 
3Froggyman 9:55 pm on Apr 3, 2001 (gmt 0)
newpost thread iconrobots and more robots - who's this guy?
  Trying to find out where this robot comes from
3torweb 3:49 pm on Apr 3, 2001 (gmt 0)
newpost thread iconNew AV spider - Scooter-3.0.g0-test
 
8mark_roach 9:56 pm on Mar 31, 2001 (gmt 0)
newpost thread iconSpiders?!
  Help me pls
3TakeTown 5:08 pm on Mar 31, 2001 (gmt 0)
newpost thread iconI wanna stop the spiders...
  ... am I crazy?
2Digital_Guerrilla 3:14 pm on Mar 30, 2001 (gmt 0)
newpost thread iconT_Rex
 
2littleman 12:02 am on Mar 30, 2001 (gmt 0)
newpost thread iconWebcraft - who is it?
  #UA WebCraft mailto:webcraft@iway.fr / IP 194.98.68.202
5oLeon 9:39 am on Mar 29, 2001 (gmt 0)
newpost thread iconRobots how to
  Need help
3maatrix 7:30 am on Mar 29, 2001 (gmt 0)
newpost thread iconMarvin/1.0 - arthur4.sda.t-online.de
 
7skirril 3:33 pm on Mar 28, 2001 (gmt 0)
newpost thread iconNew slurp
 
6vis 11:03 am on Mar 28, 2001 (gmt 0)
newpost thread iconWhat is this - Direct Hit?
 
4Marcia 2:59 pm on Mar 27, 2001 (gmt 0)
newpost thread iconteoma_agent2/1.0
 
3Froggyman 8:36 am on Mar 27, 2001 (gmt 0)
newpost thread icontv35.sv.av.com
 
4web_t 5:20 am on Mar 27, 2001 (gmt 0)
newpost thread iconthu_bacth what a bad spider name, eh?
  anybody have any guesses as to what fujitsu is doing?
3han solo 4:32 pm on Mar 26, 2001 (gmt 0)
newpost thread iconvery suspicious
 
3stn24 6:36 am on Mar 26, 2001 (gmt 0)
newpost thread iconwhat spider is this?
  i used everything i know to find out who this is but no data
4nube 2:59 pm on Mar 25, 2001 (gmt 0)
newpost thread iconrobot@digital-integrity.com
 
4web_t 3:10 am on Mar 24, 2001 (gmt 0)
newpost thread iconus.f100.mail.yahoo.com
  spider?
4balsamic 2:21 am on Mar 24, 2001 (gmt 0)
newpost thread iconSpider list
 
6Xoc 2:05 am on Mar 24, 2001 (gmt 0)
newpost thread iconYet Another Bot
 
1BoneHeadicus 1:50 am on Mar 24, 2001 (gmt 0)
newpost thread iconWho is inktomi1-bir.server.ntl.com
 
2web_t 4:50 am on Mar 22, 2001 (gmt 0)
newpost thread iconhow can I do it?
 
3jolly 6:38 am on Mar 21, 2001 (gmt 0)
newpost thread iconJust a few more
  who/what/how
3luckynh 9:04 am on Mar 20, 2001 (gmt 0)
Displaying Page 202 of 213<< Back 1 ... 192 193 194 195 196 197 198 199 200 201 [ 202 ] 203 204 205 206 207 208 209 210 211 ... 213 Next >>
Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About
© Webmaster World 1996-2014 all rights reserved