homepage Welcome to WebmasterWorld Guest from 54.166.255.168
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Home / Forums Index / Microsoft / Bing Search Engine News
Forum Library, Charter, Moderators: mack

Bing Search Engine News Forum

    
msnbot/1.0 crawling again?
Ok, so how may does msn have crawling anyway?
pendanticist

WebmasterWorld Senior Member 10+ Year Member



 
Msg#: 359 posted 4:15 pm on Feb 1, 2005 (gmt 0)

65.54.188.50 - - [31/Jan/2005:03:54:22 -0800] "GET /robots.txt HTTP/1.0" 200 1751 "-" "msnbot/1.0 (+http://search.msn.com/msnbot.htm)"

Curious mind wants to know.

 

flashfan

10+ Year Member



 
Msg#: 359 posted 8:48 pm on Feb 1, 2005 (gmt 0)

Yes, it does. It visited my site 43 times last night.

fiestagirl

10+ Year Member



 
Msg#: 359 posted 9:09 pm on Feb 1, 2005 (gmt 0)

Spotted here 1/24.
IP:
207.68.146.*
207.46.98.*
65.54.188.*

pendanticist

WebmasterWorld Senior Member 10+ Year Member



 
Msg#: 359 posted 9:13 pm on Feb 1, 2005 (gmt 0)

I don't get it.

Unless MSN is going to assign different tasks to different bots, what advantage does reverting to an older version serve?

steveb

WebmasterWorld Senior Member steveb us a WebmasterWorld Top Contributor of All Time 10+ Year Member



 
Msg#: 359 posted 12:56 am on Feb 2, 2005 (gmt 0)

They've crawled a lot, but their "starting" index ended up not very good in terms of depth of domain, as is evidenced by many threads here. Experimenting with older or other bots makes sense if they are trying to fix that deficiency.

pendanticist

WebmasterWorld Senior Member 10+ Year Member



 
Msg#: 359 posted 1:33 am on Feb 2, 2005 (gmt 0)

Thanks steveb, makes sense to me. :)

houseofsecrets

10+ Year Member



 
Msg#: 359 posted 1:55 am on Feb 2, 2005 (gmt 0)

Could it possibly be a bot for the beta in other countries? There could be an iterative process for the beta bots.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Microsoft / Bing Search Engine News
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved