Forum Moderators: open

Message Too Old, No Replies

Ant.com beta

         

keyplyr

7:14 pm on Nov 6, 2017 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



UA: Ant.com beta/1.0 (Crawling antmarks; https://www.ant.com; admin@ant.com)
Protocol: HTTP/1.1
Robots.txt: No
Host: cloudevelops.com
185.120.68.0 - 185.120.71.255
185.120.68.0/22

Since it did not request robots.txt (on this visit) it may be validating links from its index.

[delinked URL]

[edited by: keyplyr at 6:11 am (utc) on Nov 7, 2017]

lucy24

5:45 am on Nov 7, 2017 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



In the course of a few weeks last July-August, they requested the same file eight times, generally in clumps of 2-3. Never noticed, because they got resoundingly blocked. But yeah, that sounds like acting on outside information, although it wasn't a new file at the time.

keyplyr

6:12 am on Nov 7, 2017 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Same behavior, however I don't block them. I was actually one of their editors (now called contributors) 15 years ago when they were building their directory after splitting from go.com.

They offer a couple cool free tools. A bookmarker and a video downloader, as extensions to most major browsers.

If you allow their bot, you might get a little traffic from their directory.