Forum Moderators: open

Message Too Old, No Replies

SafeSearch microdata crawler

safesearch.avira.com seems to have a SafeSearch microdata crawler.

         

w3bmastine

5:11 pm on Jan 30, 2016 (gmt 0)

10+ Year Member



UA: SafeSearch microdata crawler (https://safesearch.avira.com, safesearch-abuse@avira.com)
Protocol: HTTP/1.1
Robots.txt: No
Host: AWS
52.29.105.112

Only one request, than vanished. Does anyone know more about the beast?

keyplyr

5:36 am on Feb 14, 2016 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



The "about" page at the link you provided pretty much explains what they're... (wait for it) ... about :)

They're a content filtering SE. Most all SEs and modern browsers have this as an option. This SE has it as their business model. I allow then through my AWS filters.