Forum Moderators: open

Message Too Old, No Replies

Semrushbot/0.9

         

tangor

7:46 pm on Jan 4, 2012 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



That's the UA, appeared DEC 28, returned DEC 29... honors robots.txt

Any one know what they are about? (Other than being a tool the link dev folks seem to like)

Since it is honoring robots.txt and is not taking anything beyond that, I'll not get excited at the moment.

keyplyr

8:32 pm on Jan 4, 2012 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



IP?

tangor

8:43 pm on Jan 4, 2012 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Five hits last week, all from 107.2n.

Not all that thrilled with the back biz of this company... and this is the first I've seen they have a named bot. Then again, I live a sheltered life. :)

[edited by: incrediBILL at 10:33 pm (utc) on Jan 4, 2012]
[edit reason] fixed title issue [/edit]

Pfui

10:35 pm on Jan 4, 2012 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



first I've seen they have a named bot

Psssssst...

sem rush bot and Amazon IPs
Is this an Amazon bot or a bot using Amazon?
[webmasterworld.com...]

Amazon AWS Hosts Bad Bots
amazonaws.com
[webmasterworld.com...]

semrush/whorush
web marketing tools
[webmasterworld.com...]

: )

I've not seen it disrespect robots.txt. But it comes around way too often.

(Aside to iBiILL: Can you edit the title of the thread to SemrushBot? The forum's blanking it out in some places and goofing up the capitalization in others.)

tangor

11:12 pm on Jan 4, 2012 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Well, golly gee... with that obfuscation (the space) no wonder I couldn't find it with Search before I posted... argh! I don't expect to be first to find "new" bots in this exalted company of spider finders. :)

However, it does seem like this critter is ramping up. My 107.2n. (two digits with three nnn's in each of the following) is a bit different than the previous reports. Might be one to observe.