Forum Moderators: open

Message Too Old, No Replies

SEOlyticsCrawler

         

w3bmastine

8:33 pm on Mar 15, 2016 (gmt 0)

10+ Year Member



How I loathe everything *SEO*...

UA: Mozilla/5.0 (compatible; SEOlyticsCrawler/3.0; +http://crawler.seolytics.net/)
Protocol: HTTP/1.1
Robots.txt: Yes
Host: ip-exchange.de
62.146.0.0 - 62.146.255.255
62.146.0.0/16

Of course it got blocked by SEO alone... first hit, just that IP address in my logs.

[edited by: keyplyr at 10:03 pm (utc) on Mar 15, 2016]
[edit reason] depersonalized IP address [/edit]

keyplyr

10:09 pm on Mar 15, 2016 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Of course it got blocked by SEO alone
I also filter "crawl" and allow only those I like.

lucy24

12:03 am on Mar 16, 2016 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



X-Forwarded-For: unknown
does it for me.

If you choose to deny it in robots.txt, does it obey or does it carry on regardless?

w3bmastine

9:37 am on Mar 16, 2016 (gmt 0)

10+ Year Member



I use a whitelisting in robots.txt. SEOlyticsCrawler is not mentioned in my robots.txt and stopped immediately after fetching the file.

keyplyr

9:49 am on Mar 16, 2016 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



If you sell ad space, publish Adsense or other ad networks, companies like this are beneficial IMO.

They scan your content & make the data available to marketing companies who include your site in their campaigns. Their clients then bid to place ads on your site. I allow them; the more competition the better.

However, not all companies that use the term SEO do this of course. Many can be a PITA with SPAM boasting they will "get your site #1 in Google."