Welcome to WebmasterWorld Guest from 54.162.93.137

Forum Moderators: Ocean10000 & incrediBILL

Message Too Old, No Replies

Wotbox Using Questionable Tactics?

Just Wot Are They Doing?

     
1:06 am on Jul 9, 2012 (gmt 0)

WebmasterWorld Administrator incredibill is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



Something from the UK:

81.144.138.34
"Wotbox/2.01 (+http://www.wotbox.com/bot/)"

ROBOTS.TXT: YUPPERS

They claim to crawl from these IPs:

81.144.138.34
81.144.138.40

However, I found some of my tagged content in their results pages that indicates they not only crawled from other IPs but used a stealth user agent to boot.

A couple of the other IPs I encountered were:

83.146.12.115
83.146.13.85
83.146.13.229

I almost thought it was a legit search engine startup until I ran across that garbage.

Oh well, you've been BUSTED!

BOTS BEWARE: if you put your hand in the cookie jar we're stamping it with codes that identify how the content was crawled.
1:32 am on Jul 9, 2012 (gmt 0)

WebmasterWorld Senior Member keyplyr is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month




Thanks. I didn't have it blocked or allowed. Can't remember if I've ever seen it.
9:52 pm on Jul 9, 2012 (gmt 0)

WebmasterWorld Senior Member dstiles is a WebmasterWorld Top Contributor of All Time 5+ Year Member



Slap in the middle of a BT broadband range, albeit a static range, as far as I can tell. Company called ayima according to DNS.

Actually, I have several bad hits plus another small sub-range blocked in 81.144/16 but 34 was the worst at 64 hits in a couple of months. Not sure if the others are "oops" or real bot-ish but highest number of hits on any one IP was 3 so benefit given.

There is actually a fair amount of bad behaviour within the static BT range 81.128/11 - sadly, being in the UK with UK customers, I can't block them all. :(

Nothing showing here in the 83.146/16 range.
10:26 pm on Jul 9, 2012 (gmt 0)

WebmasterWorld Senior Member g1smd is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



Ayima are a well known SEO outfit in the UK. Most of their staff are easily reachable on Twitter. Several are often at SES and SMX.

News to me that they have a bot.
8:06 am on Oct 1, 2012 (gmt 0)



Got hit today.

Robots.txt Yes (Twice!)

81.144.138.34

"Wotbox/2.01 (+http://www.wotbox.com/bot/)"

Spidered entire site from above IP address.
7:58 pm on Oct 1, 2012 (gmt 0)

WebmasterWorld Senior Member dstiles is a WebmasterWorld Top Contributor of All Time 5+ Year Member



Block 81.144.138.32 - 81.144.138.63 - that will fix them until they get another set of IPs.
10:19 pm on Oct 1, 2012 (gmt 0)

WebmasterWorld Senior Member keyplyr is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



I allow wotbox.com as I have a lot of pages with high listings, although since I added them to my whitelist I have seen only a trickle of traffic directly from their SERP.
 

Featured Threads

Hot Threads This Week

Hot Threads This Month