pendanticist
msg:1537719 | 3:56 am on Dec 7, 2003 (gmt 0) |
Earlier... [webmasterworld.com...] Pendanticist.
|
jeremy goodrich
msg:1537720 | 6:07 am on Dec 7, 2003 (gmt 0) |
I think this is the original thread here @ webmasterworld:
[webmasterworld.com...] And yep, lots of articles about how they are planning on building their own engine.
|
jdMorgan
msg:1537721 | 7:31 am on Dec 7, 2003 (gmt 0) |
Note that we're talking about two different user-agents here, msnbot and MSRBOT. Jim
|
pendanticist
msg:1537722 | 10:38 am on Dec 8, 2003 (gmt 0) |
(Lotsa threads, quite true. Been in on many of them too. Also, my bad for not finishing my thoughts when I first posted.) Because of all that 'history', I have to wonder why two technologies? Why two research centers? What could they have going on that requires what appears to be two seperate entities/factions? I heard back from Eytan Seidman regarding how this new one only crawls one very remote, very obsure file as they are experimenting and will never crawl a site completely. Huh? One file and an obscure one at that? <shrug> http://search.msn.com/msnbot.htm
http://research.microsoft.com/research/sv/msrbot/
http://research.msn.com? <-mebe markis00 could provide UA string? Pendanticist.
|
markis00
msg:1537723 | 9:38 pm on Dec 8, 2003 (gmt 0) |
it was the msrbot
|
pendanticist
msg:1537724 | 7:47 am on Dec 10, 2003 (gmt 0) |
>it was the msrbot That's not what you mention in your initial post. If you could provide the UA string, we might could get some answers. :) Thanks. Pendanticist.
|
jdMorgan
msg:1537725 | 1:30 am on Dec 22, 2003 (gmt 0) |
Just a heads-up that msnbot/0.11 is out and about, and obeying robots.txt (from what I see). It looks like a few issues seen in MSNBOT/0.1 have been fixed. 204.95.**.*** - - [21/Dec/2003:07:59:37 -0500] "GET /blah.html HTTP/1.0" 200 1231 "-" "msnbot/0.11 (+http://search.msn.com/msnbot.htm)" Jim
|
sidyadav
msg:1537726 | 11:11 pm on Dec 22, 2003 (gmt 0) |
I opened a site, a new one, and saw MSN bot crawling to before Googlebot, In about a day or so when it went alive!
And the site didn't have a single link from an external site at that time, I wonder how it finds these pages. This MSN bot is great technology. Lots of people get confused between MSN bot and MSR bot, just so if you're confused:
MSNbot - Microsoft Network Bot - Used for the search engine currently in development
MSRbot - Microsoft Research Bot - Used for the Microsoft Research project or something, they have labs at many locations. Sid
|
thehittmann
msg:1537727 | 11:04 am on Jan 4, 2004 (gmt 0) |
I've had visits from msn bot on 2 new sites, but have not touch any older sites that I have.
|
|
