Forum Moderators: open

Message Too Old, No Replies

.watson.ibm.com --

Crawler now cloaked?

         

Pfui

11:01 pm on Jan 22, 2010 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Circa 09-2009 and eons prior, UA = URL (pfffffft):

yktgi01e0-s4.watson.ibm.com
http://domino.research.ibm.com/comm/research_projects.nsf/pages/sai-crawler.callingcard.html

robots.txt? Yes

TODAY, identical server but UA now = FF (cloaked?):

yktgi01e0-s4.watson.ibm.com
Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.17) Gecko/2009122116 Firefox/3.0.17 (.NET CLR 3.5.30729)

robots.txt NO

See also: IBM Research's: "SAI Crawler" [webmasterworld.com]

keyplyr

3:36 am on Jan 23, 2010 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Still coming from 198.81.209.0/24 ?

Pfui

4:16 am on Jan 23, 2010 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Search results for "yktgi01e0-s4.watson.ibm.com" show:

ADDR: 129.34.20.23
NetRange: 129.34.0.0-129.34.255.255
CIDR: 129.34.0.0/16

(I don't include IP info unless a bot uses a bare IP because we do rDNS on the server.)