shrinktheweb

new UA, new range

[keyplyr]

UA: Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/51.0.2704.79 Safari/537.36 (https://shrinktheweb.com)
Protocol: HTTP/1.1
Robots.txt: No
Host: AWS
52.84.0.0 - 52.95.255.255
52.84.0.0/14, 52.88.0.0/13

Screenshots

Previous discussion: [webmasterworld.com...]

[lucy24]

From previous discussion:

Wonder how many of those will be shots of custom 403s?

Sounds legit to me. I can think of a couple of sites that routinely show screenshots of the target site's 403 page. (In my case, you do at least get to see the color scheme.)

[keyplyr]

Speaks highly of the site's integrity to serve a 403 to these screenshot tools.

[lucy24]

Speaks highly of the site's integrity

Do you mean shrinktheweb or the site they're visiting? (I think the previous-thread quote was from Pfui.)

I don't know anything about this specific operator. But I did finally sit down and figure out why one screenshot-showing site keeps meeting a 403. Turned out to be an extremely minor header anomaly, assisted by their lack of a distinctive UA. Sometimes things really are best treated as "no skin off my nose".

[keyplyr]

Speaks highly of the site's integrity

Do you mean shrinktheweb or the site they're visiting?

Our sites... shrinktheweb is the bot :)

Meaning if I saw a screenshot of a site's 403 page, I would assume that site was selective with whom it let infringe on it's digital property.

I do see these screenshot tools as parasites (pun intended) on those who actually create content. They take are copyrighted property and turn it into a product of theirs.

However, as always, my policy is to allow screenshots from those resources beneficial to my interests.

[lucy24]

I guess it depends on the size of the screenshot. I'm most familiar with thumbnails--the ones where I know it's my 403 page, but to everyone else it’s just words on a powder-blue background. Although sometimes, as with the “who links to you” section of GSC, even the thumbnail tells me everything I need to know. (“OK, this one’s a search engine, this one’s a directory, this one looks like an actual site, this one belongs to Google but they still weren’t able to crawl it...”)

[keyplyr]

...as with the “who links to you” section of GSC, even the thumbnail tells me everything I need to know

If the same UA did the screenshot and also did the crawl, then I could see it revealing some useable info, but most often the two bots are different, example: the DDG SE bot and it's thumbnail bot..

[lucy24]

the DDG SE bot

Is there one? I thought they used someone else's crawl data--Google's, I suppose--and just applied their own algorithm. But then, I haven't encountered their thumbnailbot either, just the faviconbot.

[keyplyr]

Duck Duck Go is a stand alone Search Engine.

[webmasterworld.com...]