Forum Moderators: open

Message Too Old, No Replies

New Bot On The Block

IBM Bot Named SAI-Crawler

         

SevenCubed

1:39 am on Aug 16, 2010 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Hmmmm looks like there might be a new kid on the block (pun intended).

Looks like IBM has unleashed a new crawler named SAI-CRAWLER. Just found it in one of my client sites log files from IP 129.34.20.17 -- grabbed the robots.txt and a single page and left. It might be nice to see an old established heavy hitter like them throw their hat into the ring and level the playing field a bit. Maybe something to look forward to.

blend27

5:55 am on Aug 16, 2010 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



They been around for a while: [domino.research.ibm.com...]

blocked on my sites, no benefit as far as I can tell.

Pfui

6:10 am on Aug 16, 2010 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Ditto. Alas, its IBM/.watson.ibm.com/129.34.20. kin have a history of misbehavior:

.watson.ibm.com -- Crawler now cloaked? (01-10) [webmasterworld.com...]
(mentions "sai-crawler" in the UA URL)

IBM Research's: "SAI Crawler" (06-09) [webmasterworld.com...]

FWIW, I rarely see IMB-marked bots nowadays. They used to be weekly pests.