Forum Moderators: open

Message Too Old, No Replies

shrinktheweb

new UA, new range

         

keyplyr

2:12 am on Oct 1, 2017 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month




UA: Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/51.0.2704.79 Safari/537.36 (https://shrinktheweb.com)
Protocol: HTTP/1.1
Robots.txt: No
Host: AWS
52.84.0.0 - 52.95.255.255
52.84.0.0/14, 52.88.0.0/13

Screenshots

Previous discussion: [webmasterworld.com...]

lucy24

3:02 am on Oct 1, 2017 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



From previous discussion:
Wonder how many of those will be shots of custom 403s?
Sounds legit to me. I can think of a couple of sites that routinely show screenshots of the target site's 403 page. (In my case, you do at least get to see the color scheme.)

keyplyr

4:16 am on Oct 1, 2017 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Speaks highly of the site's integrity to serve a 403 to these screenshot tools.

lucy24

4:37 am on Oct 1, 2017 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Speaks highly of the site's integrity
Do you mean shrinktheweb or the site they're visiting? (I think the previous-thread quote was from Pfui.)

I don't know anything about this specific operator. But I did finally sit down and figure out why one screenshot-showing site keeps meeting a 403. Turned out to be an extremely minor header anomaly, assisted by their lack of a distinctive UA. Sometimes things really are best treated as "no skin off my nose".

keyplyr

5:10 am on Oct 1, 2017 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month




Speaks highly of the site's integrity
Do you mean shrinktheweb or the site they're visiting?
Our sites... shrinktheweb is the bot :)

Meaning if I saw a screenshot of a site's 403 page, I would assume that site was selective with whom it let infringe on it's digital property.

I do see these screenshot tools as parasites (pun intended) on those who actually create content. They take are copyrighted property and turn it into a product of theirs.

However, as always, my policy is to allow screenshots from those resources beneficial to my interests.

lucy24

5:59 am on Oct 1, 2017 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



I guess it depends on the size of the screenshot. I'm most familiar with thumbnails--the ones where I know it's my 403 page, but to everyone else it’s just words on a powder-blue background. Although sometimes, as with the “who links to you” section of GSC, even the thumbnail tells me everything I need to know. (“OK, this one’s a search engine, this one’s a directory, this one looks like an actual site, this one belongs to Google but they still weren’t able to crawl it...”)

keyplyr

7:56 am on Oct 1, 2017 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



...as with the “who links to you” section of GSC, even the thumbnail tells me everything I need to know
If the same UA did the screenshot and also did the crawl, then I could see it revealing some useable info, but most often the two bots are different, example: the DDG SE bot and it's thumbnail bot..

lucy24

5:59 pm on Oct 1, 2017 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



the DDG SE bot
Is there one? I thought they used someone else's crawl data--Google's, I suppose--and just applied their own algorithm. But then, I haven't encountered their thumbnailbot either, just the faviconbot.

keyplyr

8:34 pm on Oct 1, 2017 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Duck Duck Go is a stand alone Search Engine.

[webmasterworld.com...]