Forum Moderators: open

Message Too Old, No Replies

woobot

         

topr8

11:20 am on Oct 2, 2016 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



UA: woobot/2.0
Robots.txt: Yes
Host: AWS
52.5.69.31ip-52-5-69-31.core.woorank.com

seems to only have one ip address allocated at aws, adjacent addresses are not theirs.
there are 4 mentions of woorank on WebmasterWorld since 2011, but none in this forum.
from their homepage: Get an immediate overview of what your competitors are up to

keyplyr

11:28 am on Oct 2, 2016 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Ya know, I think I posted a profile for woobot in this forum about 6 months ago, but you're correct, it can't be found.

Thanks for posting topr8

keyplyr

11:28 pm on Oct 2, 2016 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Ran a test from woorank.com.

UA: woobot/2.0
Protocol: HTTP/1.1
Robots.txt: No
Host: AWS
54.160.0.0 - 54.175.255.255
54.160.0.0/12

So while 52.5.69.31 may be the crawl range assigned to woorank.com, like any good cloud server, the agent can come randomly from other nodes.

Additionally, it seems their script is config'd to only run HTTP (not HTTPS.) I entered an HTTPS web address and the UA requested HTTP at target.