Welcome to WebmasterWorld Guest from 54.166.236.238

Forum Moderators: Ocean10000 & incrediBILL & keyplyr

Message Too Old, No Replies

Who.is Bot

     
10:59 am on Mar 11, 2012 (gmt 0)

Junior Member

10+ Year Member

joined:Nov 1, 2006
posts: 66
votes: 0


174.36.196.nnn - - [11/Mar/2012:00:17:03 +0100] "GET / HTTP/1.1" 301 ... www... "-" "Who.is Bot" "-"
174.36.196.nnn - - [11/Mar/2012:00:17:04 +0100] "GET / HTTP/1.1" 200 ... ... "-" "Who.is Bot" "-"

United States Dallas Softlayer Technologies Inc
AS36351, 174.36.0.0/15
Host: 174.36.196.nnn-static.reverse.softlayer.com

Second visit in 6 months from this IP. Ignores robots, follows redirects.

Kinda dull, eh?
11:08 am on Mar 11, 2012 (gmt 0)

Administrator from US 

WebmasterWorld Administrator incredibill is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Jan 25, 2005
posts:14664
votes: 99


Most spider hunters block all of Softlayer and would never notice.

Rather clever bot name as it's also their domain name "who.is"
12:23 pm on Mar 11, 2012 (gmt 0)

Junior Member

10+ Year Member

joined:Nov 1, 2006
posts: 66
votes: 0


Softlayer is PNG here too. This is the first visit from an IP in that range since I blocked it last October. It got routed to a nothing page by a home-brewed WordPress plugin.

From their whois:
Comment: Our motto: Innovate or Die.

Pity it's not a call for a vote.
9:53 pm on Mar 11, 2012 (gmt 0)

Senior Member from US 

WebmasterWorld Senior Member lucy24 is a WebmasterWorld Top Contributor of All Time 5+ Year Member Top Contributors Of The Month

joined:Apr 9, 2011
posts:13902
votes: 491


:: insert classic Jack Benny line here ::

Robots that follow redirects tend to make me uneasy. Unless they're www or directory-slash redirects, which don't really count. At least for robotic purposes.
10:29 pm on Mar 11, 2012 (gmt 0)

Junior Member

10+ Year Member

joined:Nov 1, 2006
posts: 66
votes: 0


I entirely agree, Lucy24. In this case it was a www redirect. The jury is out for now.

Pray tell, what's that Jack Benny line?
11:51 pm on Mar 11, 2012 (gmt 0)

Administrator from US 

WebmasterWorld Administrator incredibill is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Jan 25, 2005
posts:14664
votes: 99


Having written a robot, a redirect is a redirect, they don't know one 301 or 302 from the other.

It's when they start chasing meta redirects and javascript redirects you should get nervous, and I did that too :)
12:19 am on Mar 12, 2012 (gmt 0)

Senior Member from US 

WebmasterWorld Senior Member lucy24 is a WebmasterWorld Top Contributor of All Time 5+ Year Member Top Contributors Of The Month

joined:Apr 9, 2011
posts:13902
votes: 491


they don't know one 301 or 302 from the other

But it can be included in the programming, can't it? "IF you're redirected from your target URL to the identical URL plus or minus www THEN follow the redirect, ELSE report back to me."

Search-engine robots definitely distinguish between www redirects and "real" redirects. You can see them hippity-hopping in the logs, making two consecutive requests for the same page: a 301 followed by a 200.

what's that Jack Benny line?

"Your money or your life!"
"... I'm thinking! I'm thinking!"
2:16 am on Mar 12, 2012 (gmt 0)

Administrator from US 

WebmasterWorld Administrator incredibill is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Jan 25, 2005
posts:14664
votes: 99


You can see them hippity-hopping in the logs, making two consecutive requests for the same page: a 301 followed by a 200.


Um, that's no different than if anything followed the same redirect, or any other redirect, nothing special.
4:21 am on Mar 12, 2012 (gmt 0)

Moderator This Forum from US 

WebmasterWorld Administrator keyplyr is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Sept 26, 2001
posts:9228
votes: 439



Most spider hunters block all of Softlayer and would never notice.

'nuff said
5:28 am on Mar 12, 2012 (gmt 0)

Senior Member from US 

WebmasterWorld Senior Member lucy24 is a WebmasterWorld Top Contributor of All Time 5+ Year Member Top Contributors Of The Month

joined:Apr 9, 2011
posts:13902
votes: 491


I went off to investigate a few random logs and instead found another goofy UA from a blocked IP (China).

Mozilla/4.0 (compatible; MSIE 6.0; MSIE 5.5; Windows NT 4.0) Opera 7.0 [en]

Uh... Make up your mind, willya? Come to think of it, didn't someone post about this variant recently?

Anyway, quick eyeballing suggests that what I get the most of is not 301-plus-200-- except Yandex, which can't get it into its head that it's with www-- but 301-plus-403.

The ones that intrigue me are the ones that ask for robots.txt at the wrong address, get redirected, and never come back. Makes it seem as if they never really wanted it in the first place, doesn't it?
5:31 am on Mar 12, 2012 (gmt 0)

Administrator from US 

WebmasterWorld Administrator incredibill is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Jan 25, 2005
posts:14664
votes: 99


I went off to investigate a few random logs and instead found another goofy UA from a blocked IP (China).


... and that relates to who.is how?

I'm lost on how it ties into this thread, unless I missed the point, new thread perhaps?
11:03 am on Mar 12, 2012 (gmt 0)

Senior Member

WebmasterWorld Senior Member wilderness is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Nov 11, 2001
posts:5460
votes: 3


I'm lost on how it ties into this thread, unless I missed the point, new thread perhaps?


Bill, you provided an answer in your first reply, which caused a controversy in another thread.

After the answer was provided, the subsequent replies are all rambling, lucy just added a little more rambling ;)
4:19 pm on Mar 12, 2012 (gmt 0)

Senior Member from US 

WebmasterWorld Senior Member lucy24 is a WebmasterWorld Top Contributor of All Time 5+ Year Member Top Contributors Of The Month

joined:Apr 9, 2011
posts:13902
votes: 491


and that relates to who.is how?

I went off to check on the redirect question and got redirected ;)

I think everyone's now up to speed on who who.is is. Except that the name keeps making me think it's "whois.deliriumtremens.com" (substituting for Unprintable Name in the middle).