homepage Welcome to WebmasterWorld Guest from 50.17.21.7
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Visit PubCon.com
Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification Forum

    
and another gets on.
lucy24




msg:4534501
 1:17 am on Jan 9, 2013 (gmt 0)

199.30.16.75 - - [08/Jan/2013:10:04:02 -0800] "GET /robots.txt HTTP/1.1" 200 620 "-" "msnbot/2.0b (+http://search.msn.com/msnbot.htm)"
199.30.16.75 - - [08/Jan/2013:10:04:02 -0800] "GET /sitemap.xml HTTP/1.1" 200 3880 "-" "msnbot/2.0b (+http://search.msn.com/msnbot.htm)"


... and your point is?

199.30.16.0/20 Microsoft. Didn't they just add a new range the week before last? Now here they are again with still another.

Yes, it's really only .16.0/20. I checked. 199.30.0.0/20 is Sara Lee. And as long as I was there, I looked up other recent visitors from the neighborhood. 199.30.80.0/22 is StumbleUpon; 199.30.228.0/22 is DomainTools.

199 is going to be another of those abominable ranges like 91 or 193 where you never know what's in the /22 next door. I am not looking forward to v6-thingie at all. There will be :: business with calculator :: 65536 times as many of them. :(

 

lucy24




msg:4537040
 7:05 am on Jan 18, 2013 (gmt 0)

:: bump ::

Don't know what MS's long-term plan for this, uhm, rangette is. But the latest batch of logs had them trying it out on msnbot-media. I was alerted by the huge number of requests for robots.txt from an unaccustomed quarter.

:: edit, edit, edit in log-wrangling function ::

bingbot and msnbot don't get the huge number of spoofers that googlebot does, but it's enough that I can't just wave in anyone who flashes a Bingbot ID. Well, I could. This isn't my day job. But I don't feel like it.

keyplyr




msg:4537088
 10:41 am on Jan 18, 2013 (gmt 0)

Didn't they just add a new range the week before last?

Really? What MS range was added week before last?

lucy24




msg:4537095
 11:26 am on Jan 18, 2013 (gmt 0)

All right, if you're going to be hair-splittingly technical, it was late June for the 131.253 range. :P It's got a thread of its own.

keyplyr




msg:4537117
 1:25 pm on Jan 18, 2013 (gmt 0)

Thanks, but 131.253.21.0 - 131.253.47.255 has been on/off bot running for nearly 6 years (I added it for MS in March, 2007.) You had me wondering if I actually missed a new one.

note: I don't play tag with bots. If the range is owned by a major SE, I allow them to do anything they like except cache/copy my content (e.g. translators, transcoders, etc.)

However, I personally hadn't seen any bot activity from 199.30.16.0 - 199.30.31.255. Thanks for the heads-up.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved