Welcome to WebmasterWorld Guest from 3.227.233.6
Forum Moderated by: Ocean10000
Search Engine Spider and User Agent Identification
Forum to identify search engine spiders and user agents
| Thread Subject | Messages | Started by | Last Message | ||||
|---|---|---|---|---|---|---|---|
| Server Farms - July 2018 Continuing discussion of hosting company IP ranges[5] ( 1 2 3 4 5 ) |
132 | keyplyr | 3:03 pm Jun 13, 2019 | ||||
| Robot's User Agent String What webmasters want |
1 | keyplyr | 9:34 pm Oct 14, 2018 | ||||
| At Home with the Robots: 2017 edition Critique of the Year's Active User Agents |
15 | lucy24 | 3:52 pm May 18, 2017 | ||||
| Blocking Methods How to block access to your server |
1 | keyplyr | 6:29 pm May 10, 2017 | ||||
| User Agents of Programming Libraries and Command Line Tools Common user agents |
14 | incrediBILL | 8:54 pm Apr 29, 2008 | ||||
| RDDocuments |
1 | Pfui | 2:25 pm Aug 25, 2019 | ||||
| 0 | 12:00 am Jan 1, 1970 | ||||||
| Plague of Viewbots help on how to detect view bots? |
12 | PeachyCheech | 8:47 pm Aug 22, 2019 | ||||
| Looking at some strange hits from Microsoft IP's Some are from outlook outbound mail servers? |
2 | SumGuy | 6:27 am Aug 21, 2019 | ||||
| Firefox on Mac User-agent -> version number is 4-digit hex value Seeing coordinated bot activity |
4 | SumGuy | 1:38 am Aug 16, 2019 | ||||
| User Agent cdnposUserAgentcdnpos<> 3.224.211.xxx |
2 | Bewenched | 8:22 pm Aug 13, 2019 | ||||
| Seeing hits from 3.0.0.0/8 for first time Is Amazon |
9 | SumGuy | 7:15 pm Aug 13, 2019 | ||||
| Bad Bot hack attempts 23.83.128.0/21 |
5 | Bewenched | 5:45 pm Aug 13, 2019 | ||||
| Instapaper/7.7.1.2 CFNetwork/978.0.7 Darwin/18.6.0 |
3 | tangor | 3:37 am Aug 3, 2019 | ||||
| Mb2345Browser/9.0 I'm pretty sure this is actually a crawler, not a browser |
6 | notriddle | 8:21 pm Aug 2, 2019 | ||||
| newspaper |
9 | Pfui | 10:32 pm Jul 29, 2019 | ||||
| Facebook pretending to be Bing Bing UA from Facebook IP |
8 | dstiles | 10:21 am Jul 29, 2019 | ||||
| ?source=post page--------------------------- What the--? |
6 | Pfui | 6:24 am Jul 29, 2019 | ||||
| Chrome Lighthouse redux |
3 | lucy24 | 12:13 am Jul 29, 2019 | ||||
| Safe to Block HeadlessChrome? |
9 | glakes | 1:16 am Jul 26, 2019 | ||||
| two from Facebook |
13 | lucy24 | 5:39 pm Jul 25, 2019 | ||||
| Another funny fake user agent string |
5 | notriddle | 5:48 pm Jul 21, 2019 | ||||
| Hit from "Blockchain Network Solutions" Not sure what it's trying to accomplish |
3 | SumGuy | 10:06 am Jun 4, 2019 | ||||
| Hits from 104.132.0.0/16 (Google) - human or bot? |
8 | SumGuy | 2:04 pm Jun 3, 2019 | ||||
| adscanner redux |
1 | lucy24 | 6:17 pm Jun 2, 2019 |
Join The Conversation
- Register For Free! - Become a Pro Member!
- See forum categories - Enter the Forum
Moderators and Top Contributors
- Moderator List | Top Contributors:This Week, This Month, Jul, Jun, Archive, Top 100 All Time, Top Voted Members
Hot Threads This Week
- Google Updates and SERP Changes - August 2019
- August 2019 AdSense Earnings & Observations
- FTC sends signal it could break up big tech
- Facebook to Change Groups to Public or Private
- Update Maverick: Google SERP Changes - July 2019
- Danny Sullivan on Google Core Updates and how to deal with them
- Net Businesses Forge "Confidential Computing Consortium"
- Google SERPs to Show Individual Podcasts
- E.U. Court Says Sites Using Facebook Like Button are Liable for Data
- E.U. Opens Antitrust Investigation Into Amazon's Practices
Featured Threads
- Net Businesses Forge "Confidential Computing Consortium"
- Facebook to Change Groups to Public or Private
- Google SERPs to Show Individual Podcasts
- Danny Sullivan on Google Core Updates and how to deal with them
- Google Updates and SERP Changes - August 2019
- E.U. Court Says Sites Using Facebook Like Button are Liable for Data
- Facebook Fined $5 billion Over Privacy Violations
- Update Maverick: Google SERP Changes - July 2019
- E.U. Opens Antitrust Investigation Into Amazon's Practices
- New Twitter Desktop Rolling Out