Toggle navigation
Dashboard
Dashboard Tracker
Add / Edit My Forums
System Announcements
Discussion
Active Thread Feed
Top Threads Today
Top Threads This Week
Top Threads Library
Go!
View All
View All
Login
Logout
Home
Forums Index
General SEO Issues
/
Crawler, Spider, and User Agent ID
3:43 am Aug 4, 2026
This page requires javascript.
Forum Moderators:
open
Message Too Old, No Replies
Odd UA acting bad
tangor
Msg#:5045227
3:45 am on Aug 13, 2021
(gmt 0)
UA: Mozilla/5.0 (Windows NT 6.3; Trident/7.0; rv:11.0) like Gecko
MS Azure
23.101.171.xx
52.240.137.xxx
Aggressive, two days (I was away), ripped entire site multiple times. UA seems "incomplete", at least in my experience.
jmccormac
Msg#:5045257
8:43 am on Aug 13, 2021
(gmt 0)
Cloud rather than genuine user? Most requests originating from cloud services are problematic at best these days.
Regards...jmcc
lucy24
Msg#:5045305
5:46 pm on Aug 13, 2021
(gmt 0)
:: detour to raw logs ::
I find a fair number of this UA, every last one blocked :)
:: further detour to logged headers ::
Aha. They don't send Accept-Language. That would do it. (Also only the minimalist Accept: */*, used by a number of law-abiding robots but no humans.)
Join The Conversation
Register
For Free! -
Become a
Pro Member
!
See forum categories
-
Enter the Forum
Moderators and Top Contributors
Moderator List
| Top Contributors:
This Week
,
This Month
,
Jul
,
Jun
,
Archive
,
Top 100 All Time
,
Top Voted Members
Hot Threads This Week
July 2026 Google Search Observations
August 2026 Google Search Observations
AdSense Earnings and Observations - August 2026
AdSense Earnings and Observations - July 2026
Do LLMs actually read your schema?
Annoying Crawler, Bot, or what?
Do you get tired of others copying your content?
Do you still build external links in 2026?
Google started experiment; auto optimise turned off
SkypeUriPreview - links pasted into MS 365 Outlook
Home
Forums Index
General SEO Issues
/
Crawler, Spider, and User Agent ID
3:43 am Aug 4, 2026