Forum Moderators: goodroi

Message Too Old, No Replies

Agent Name for MSN

Where can I find this information.

         

Pat1975

1:50 pm on May 21, 2005 (gmt 0)

10+ Year Member



What is the agent name for MSN. Where can I find an up-to-date list of all the major search engines' agent name.

Thanks in advance.

ThomasB

4:19 pm on May 21, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



The MSN bot is called "msnbot" [search.msn.com...]

And here's a robots list: [robotstxt.org...]

Pat1975

5:06 am on Jun 1, 2005 (gmt 0)

10+ Year Member



Hello, may I ask once again what is the robot name for Yahoo, I couldn't find it it the list, is it the same one as Inkomi?

Pat1975

5:15 am on Jun 1, 2005 (gmt 0)

10+ Year Member



More questions:

The user-agent name for msnbot is "MSNBOT/0.1". Do I need to type the name exactly match the above name or just "msnbot"?

Thanks in advance.

fiestagirl

9:43 pm on Jun 1, 2005 (gmt 0)

10+ Year Member



If you go here: [search.msn.com...]

and look at the part that says "use this syntax" you will see how to do it.

Dijkgraaf

9:55 pm on Jun 1, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Yahoo has two bots
"Yahoo-MMCrawler/3.x (mms dash mmcrawler dash support at yahoo dash inc dot com)"
"Mozilla/5.0 (compatible; Yahoo! Slurp; [help.yahoo.com...]
Of course it would be nice if the URL in the bot actually worked, the correct URL is
[help.yahoo.com...] (Note the trailing slash is required).

Pat1975

5:40 am on Jun 3, 2005 (gmt 0)

10+ Year Member



Thanks to all.

jdMorgan

5:55 am on Jun 3, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



MSN also has two crawlers, msnbot, and MSNPTC (their Preview technology crawler, used to generate the thumbnail screenshot "Page previews" visible if you use MSN search as the default IE search provider.)

However, MSNPTC apparently also obeys robots.txt records addressed to "msnbot", and so does not require its own robots.txt record.

Jim