homepage Welcome to WebmasterWorld Guest from 184.72.72.182
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification

Search Engine Spider and User Agent Identification

Forum Charter, Library, Moderated by: Ocean10000 & incrediBILL Forum Options: Reset Last Read Pointers

PreModerated forum to id search engine spiders

 
new Subject Messages Started by Last Message
newpost thread iconCome on Yahoo. Really?
 
7bobothecat2 8:38 pm on Dec 27, 2013 (gmt 0)
newpost thread iconwho's on 168?
 
1lucy24 3:10 am on Dec 22, 2013 (gmt 0)
newpost thread iconarchive.org bot
  bad bot
7keyplyr 7:20 am on Dec 20, 2013 (gmt 0)
newpost thread iconGoogle Test-Bot: Google-Test2
 
11doc_z 8:28 pm on Dec 19, 2013 (gmt 0)
newpost thread iconGoogle? Is that you?
 
13lucy24 10:33 pm on Dec 18, 2013 (gmt 0)
newpost thread iconIs there a Browser. . .
 
10wilderness 12:53 am on Dec 16, 2013 (gmt 0)
newpost thread iconTECH UPDATE: Javascript Makes Dumb Bots Obsolete
  Javascript Must Be Crawled For Scrapers To Survive
3incrediBILL 10:12 pm on Dec 15, 2013 (gmt 0)
newpost thread iconthe plainclothes bingbot
 
8lucy24 8:03 pm on Dec 14, 2013 (gmt 0)
newpost thread iconYahoo:LinkExpander:Slingstone
 
7keyplyr 2:06 pm on Dec 13, 2013 (gmt 0)
newpost thread iconGoogle Translate
 
7wilderness 2:43 am on Dec 11, 2013 (gmt 0)
newpost thread iconYaBrowser
 
15lucy24 10:04 am on Dec 10, 2013 (gmt 0)
newpost thread iconwscheck
 
1lucy24 1:17 am on Dec 10, 2013 (gmt 0)
newpost thread iconthis time it's Sogou
  61.135 returns
1lucy24 11:32 pm on Dec 9, 2013 (gmt 0)
newpost thread iconNew stupid referer spammer
  Referer spam via agent string (mistyped)
9yaimapitu 2:58 pm on Dec 8, 2013 (gmt 0)
newpost thread iconrarely used
 
12lucy24 9:22 am on Dec 1, 2013 (gmt 0)
newpost thread iconNew Scraping Tool
 
9keyplyr 9:07 am on Nov 28, 2013 (gmt 0)
newpost thread iconBixocrawler
  Another data miner
1dstiles 4:02 pm on Nov 24, 2013 (gmt 0)
newpost thread iconCleaning House
  blocked IP ranges may have changed
1keyplyr 10:19 am on Nov 24, 2013 (gmt 0)
newpost thread iconYahoo phone home
 
19lucy24 8:07 pm on Nov 23, 2013 (gmt 0)
newpost thread iconAmazon aws, dedicatedcpanel, serverloft Issues
  These domains are dedicatedly screwing my site - Need Help.
10Future 7:59 pm on Nov 23, 2013 (gmt 0)
newpost thread iconTECH UPDATE: Bots as Browsers Using JavaScript[2] ( 1 2 )
  The Bot Detection Game Has Changed
48incrediBILL 9:18 pm on Nov 11, 2013 (gmt 0)
newpost thread icongoogle-xrawler
  Unknown User agent "google-xrawler"
15DutchTheWiz 7:51 pm on Nov 7, 2013 (gmt 0)
newpost thread iconZylon
 
4lucy24 8:32 pm on Nov 6, 2013 (gmt 0)
newpost thread iconIs CompSpyBot really an NSASpyBot?
 
17evsiz 7:55 pm on Oct 30, 2013 (gmt 0)
newpost thread icon50.16.178.xx Amazon of course
  linkCheck
2Bewenched 8:21 pm on Oct 24, 2013 (gmt 0)
Displaying Page 6 of 215<< Back 1 2 3 4 5 [ 6 ] 7 8 9 10 11 12 13 14 15 ... 215 Next >>
Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved