Forum Moderators: open

Message Too Old, No Replies

SEOkicks-Robot

         

keyplyr

3:28 am on Oct 30, 2015 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



UA: Mozilla/5.0 (compatible; SEOkicks-Robot; +http://www.seokicks.de/robot.html)
Protocol: HTTP/1.0
Robots.txt: Yes
Host: Hetzner.com
144.76.0.0 - 144.76.255.255
144.76.0.0/16

Mentioned in other forum posts as "bad" but IMO not a malicious agent, just not beneficial. They are gathering back-link data to use in their services/products they sell. They do attempt to keep the server load light. However, that was more of an issue a few years ago but with most hosts using SSD w/ unlimited bandwidth today, probably not a big deal now (example: bingbot pounds my site 3Xs a day with no ill effects.)

blend27

4:05 pm on Oct 30, 2015 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



They are gathering back-link data to use in their services/products they sell

and HOW many of them(They) are already useless out there?

keyplyr

9:22 pm on Oct 30, 2015 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



What's useless? Backlink data is extremely valuable in marketing dynamics.

blend27

4:42 am on Nov 12, 2015 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Useless as in:

Moz, MJ12 and AHrefs are trying to spider 127,121 back links pointing to 4K pages on a site that was hacked Jul 2014. Spam pages were created. So does SEOkicks. Pages Removed in September upon findings.

Without robots.txt, .htaccess these create a havoc in logs. None provide actual referrer where they got the link from(unless one gives in for a linkbate promo), not that I care, those were hacked /created junk.

All were notified that the network of pages that link to "hacked pages" are also hacked via email.

Bird Breeding/US
site has more than 1500 back-links from a manufacturer/China of "ad you fancy here" discovered with in last 2 month with "Nike Shoes Sale" as an anchor and URI being crawled.

Very Useful.

keyplyr

7:28 am on Nov 12, 2015 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Links need to be crawled before the aggregated data is detetmined. Just how it works.