homepage Welcome to WebmasterWorld Guest from 54.226.43.155
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification

Search Engine Spider and User Agent Identification

Forum Charter, Library, Moderated by: Ocean10000 & incrediBILL Forum Options: Reset Last Read Pointers

PreModerated forum to id search engine spiders

 
new Subject Messages Started by Last Message
newpost thread iconDanish spider?
  Marvin v0.5 - 130.225.20.4
4Will 3:57 pm on Sep 10, 2001 (gmt 0)
newpost thread iconWhat kind of spider is this?
  WebCopier+v.2.2, ip - 24.88.11.3
2stanleytk 12:52 pm on Sep 10, 2001 (gmt 0)
newpost thread iconUA Lifeboat
  followed by Mozilla/4.0 (compatible; MSIE 4.0; Windows NT; ....../1.0 ).
2bobriggs 6:09 pm on Sep 8, 2001 (gmt 0)
newpost thread iconwap spider
  or is this a browser???
3mack 2:48 pm on Sep 8, 2001 (gmt 0)
newpost thread iconA CSS and JS sniffer?
  Can't track this one
5Macguru 4:55 pm on Sep 7, 2001 (gmt 0)
newpost thread iconAtlantisSearch/0.1b webmaster@jippii.fi
  195.211.11.50
2volatilegx 5:27 pm on Sep 6, 2001 (gmt 0)
newpost thread iconbumblebee@relevare.com
 
12Son_House 4:51 pm on Sep 6, 2001 (gmt 0)
newpost thread iconMercator
  TV33_Mercator_1-1.0
11startup 3:44 pm on Sep 6, 2001 (gmt 0)
newpost thread iconA Sneaky Spider
  what the heck is compete.com spidering for?
6idiotgirl 9:18 am on Sep 6, 2001 (gmt 0)
newpost thread iconMarkwatch
 
1Brett_Tabke 6:06 pm on Sep 5, 2001 (gmt 0)
newpost thread iconFetch API?
 
2Josk 2:25 pm on Sep 5, 2001 (gmt 0)
newpost thread iconUnidentified Crawler: (Indy Library)
  Looking for any information about the following message.
2JDDJ 7:53 pm on Sep 4, 2001 (gmt 0)
newpost thread iconblocking Scooter in robots.txt
 
1Crazy_Fool 2:46 pm on Sep 4, 2001 (gmt 0)
newpost thread iconLynx viewer
  doesn't see a page
4Abe 11:50 am on Sep 2, 2001 (gmt 0)
newpost thread iconSlarp and LWP::Simple
  64.23.82.44 data1.only.com
1Son_House 9:24 am on Aug 31, 2001 (gmt 0)
newpost thread iconSpider
  Need IDENTIFICATION
2creepycrawler 2:50 am on Aug 31, 2001 (gmt 0)
newpost thread iconscooter-3.0.vns
  new to me
10Marcia 7:00 pm on Aug 30, 2001 (gmt 0)
newpost thread iconSureseeker
  We know what you did last night...
1Josk 10:33 am on Aug 30, 2001 (gmt 0)
newpost thread iconIs this a new spider
 
9TerryS 9:24 pm on Aug 29, 2001 (gmt 0)
newpost thread iconSMS service
  How do i make a SMS service?
2ddsworld 5:03 pm on Aug 29, 2001 (gmt 0)
newpost thread iconPicsearch == deny from
 
2toolman 4:36 pm on Aug 29, 2001 (gmt 0)
newpost thread iconMysterious
  24.216.220.210
3volatilegx 11:10 pm on Aug 28, 2001 (gmt 0)
newpost thread iconHow do i make a search engine?
  make search engines?
9ddsworld 4:36 pm on Aug 28, 2001 (gmt 0)
newpost thread iconMicrosoft+URL+Control
  65.113.184.110
4Crazy_Fool 10:20 am on Aug 28, 2001 (gmt 0)
newpost thread iconspider identification
  never seen this spider in MN before help identify
5jnlomn 2:51 am on Aug 28, 2001 (gmt 0)
Displaying Page 195 of 215<< Back 1 ... 185 186 187 188 189 190 191 192 193 194 [ 195 ] 196 197 198 199 200 201 202 203 204 ... 215 Next >>
Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved