Welcome to WebmasterWorld Guest from 35.175.191.168
Forum Moderated by: Ocean10000
Search Engine Spider and User Agent Identification
Forum to identify search engine spiders and user agents
| Thread Subject | Messages | Started by | Last Message | ||||
|---|---|---|---|---|---|---|---|
| Server Farms - July 2018 Continuing discussion of hosting company IP ranges[5] ( 1 2 3 4 5 ) |
132 | keyplyr | 3:03 pm Jun 13, 2019 | ||||
| Robot's User Agent String What webmasters want |
1 | keyplyr | 9:34 pm Oct 14, 2018 | ||||
| At Home with the Robots: 2017 edition Critique of the Year's Active User Agents |
15 | lucy24 | 3:52 pm May 18, 2017 | ||||
| Blocking Methods How to block access to your server |
1 | keyplyr | 6:29 pm May 10, 2017 | ||||
| User Agents of Programming Libraries and Command Line Tools Common user agents |
14 | incrediBILL | 8:54 pm Apr 29, 2008 | ||||
| Google hiccup |
3 | wilderness | 9:33 am Oct 14, 2019 | ||||
| 0 | 12:00 am Jan 1, 1970 | ||||||
| whisper |
8 | lucy24 | 4:59 pm Oct 12, 2019 | ||||
| ApiTool |
1 | Pfui | 7:23 am Oct 7, 2019 | ||||
| Google-Read-Aloud |
1 | lucy24 | 8:48 pm Oct 6, 2019 | ||||
| Hi Pages exploit UA |
15 | Pfui | 5:26 am Oct 5, 2019 | ||||
| URI: ./ ./ mnt/ custom/ ProductDefinition DVR remote code execution |
3 | Pfui | 5:35 pm Sep 27, 2019 | ||||
| Yisou again |
2 | lucy24 | 12:06 am Sep 27, 2019 | ||||
| GrumpyCrawler Microsoft range |
3 | Pfui | 6:02 pm Sep 24, 2019 | ||||
| Thinking of blocking 40.64.0.0/10 and 51.140.0.0/14 (MSFT) Seen some bot stuff recently |
2 | SumGuy | 5:53 am Sep 24, 2019 | ||||
| myAgent Microsoft range |
1 | Pfui | 11:45 am Sep 23, 2019 | ||||
| Mb2345Browser/9.0 I'm pretty sure this is actually a crawler, not a browser |
8 | notriddle | 2:51 am Sep 10, 2019 | ||||
| Hakai |
1 | Pfui | 3:57 am Sep 9, 2019 | ||||
| serpstatbot/1.0 (advanced backlink tracking bot |
3 | notriddle | 9:28 pm Sep 3, 2019 | ||||
| Moreover |
4 | lucy24 | 1:18 am Sep 2, 2019 | ||||
| BingPreview from Facebook |
4 | lucy24 | 8:50 pm Sep 1, 2019 | ||||
| GoogleImageProxy redux; runs amok |
9 | Pfui | 11:22 am Aug 30, 2019 | ||||
| looid.com Search Engine |
3 | Pfui | 4:54 am Aug 29, 2019 | ||||
| RDDocuments |
1 | Pfui | 2:25 pm Aug 25, 2019 | ||||
| Plague of Viewbots help on how to detect view bots? |
12 | PeachyCheech | 8:47 pm Aug 22, 2019 |
Join The Conversation
- Register For Free! - Become a Pro Member!
- See forum categories - Enter the Forum
Moderators and Top Contributors
- Moderator List | Top Contributors:This Week, This Month, Sep, Aug, Archive, Top 100 All Time, Top Voted Members
Hot Threads This Week
- Google Updates and SERP Changes - October 2019
- Google September 2019 Core Update
- October 2019 AdSense Earnings & Observations
- 2019 SEO Starters Guide - What to work on
- From Hobby Websites to Making Money
- Google Updates and SERP Changes - September 2019
- Windows Virtual Desktop Service is Now Available World-wide
- ApiTool
- Impact of Ad Density On Google Rankings
- Google Adds New Options to rel = NOFOLLOW Attribute
Featured Threads
- New Evergreen Bingbot Now Adopts Microsoft Edge as Bing Engine
- Google Updates and SERP Changes - October 2019
- 2019 SEO Starters Guide - What to work on
- Windows Virtual Desktop Service is Now Available World-wide
- Google September 2019 Core Update
- Google Algorithmic Updates to Reviews in Rich Results
- Google Search Now Highlights "Key Moments" in Videos
- Google News Ranking Changes and New Rater Guidelines
- Google Updates Search Quality Raters Guidelines on Sept 5, 2019
- Google Adds New Options to rel = NOFOLLOW Attribute