Welcome to WebmasterWorld Guest from 3.90.108.129

Forum Moderated by: Ocean10000

Search Engine Spider and User Agent Identification


Forum to identify search engine spiders and user agents

 
Thread SubjectMessagesStarted byLast Message
Server Farms - July 2018
Continuing discussion of hosting company IP ranges[5] ( 1 2 3 4 5 )
132 keyplyr 3:03 pm Jun 13, 2019
Robot's User Agent String
What webmasters want
1 keyplyr 9:34 pm Oct 14, 2018
At Home with the Robots: 2017 edition
Critique of the Year's Active User Agents
15 lucy24 3:52 pm May 18, 2017
Blocking Methods
How to block access to your server
1 keyplyr 6:29 pm May 10, 2017
User Agents of Programming Libraries and Command Line Tools
Common user agents
14 incrediBILL 8:54 pm Apr 29, 2008
 
0 12:00 am Jan 1, 1970
Hit from "Blockchain Network Solutions"
Not sure what it's trying to accomplish
3 SumGuy 10:06 am Jun 4, 2019
Hits from 104.132.0.0/16 (Google) - human or bot?
8 SumGuy 2:04 pm Jun 3, 2019
adscanner redux
1 lucy24 6:17 pm Jun 2, 2019
Apache OpenOffice
10 lucy24 7:23 pm May 31, 2019
FaceBook iPhone UA
2 wilderness 1:33 pm May 31, 2019
OrgProbe/2.0.0
Checking to see if my site is up?
2 SumGuy 9:20 pm May 20, 2019
Hits from Cisco Ironport
What is their purpose?
2 SumGuy 2:52 pm May 20, 2019
Getting hammered by Bingbot
7 tangor 12:50 pm May 18, 2019
Evergreen Googlebot Now Runs Latest Chromium Rendering Engine
6 engine 12:37 am May 15, 2019
AHC/2.1 from UK Amazon 3.8.
1 not2easy 3:43 pm Apr 20, 2019
possible new bing crawl range
2 lucy24 1:54 am Apr 12, 2019
Bots start looking for back.zip, backup.zip, etc.
Get rid of those if you have them in root.
3 SumGuy 12:32 pm Apr 10, 2019
Google-speakr
6 phranque 9:23 pm Apr 5, 2019
User Agent is Microsoft Office something or other
5 SumGuy 8:29 pm Apr 4, 2019
Google 34
2 lucy24 1:48 am Apr 2, 2019
Facebook cortex
8 lucy24 1:21 am Apr 2, 2019
35.244.0.0/14 - Google or Merit (U-Mich) ?
4 SumGuy 6:23 pm Apr 1, 2019
Getting lots of hits from this Cloudsigma. what's it?
3 born2run 5:58 am Mar 24, 2019
Apple applebot increasing activity
Increasing hits to interior web pages
4 SumGuy 4:32 am Mar 18, 2019

Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members