Welcome to WebmasterWorld Guest from 54.158.25.146

Forum Moderators: mack

Message Too Old, No Replies

Microsoft crawling websites?

I found a microsoft bot crawling my pages.

     
4:30 am on Jul 17, 2003 (gmt 0)

Junior Member

10+ Year Member

joined:Mar 22, 2003
posts:64
votes: 0


Does anyone know what microsoft is doing with the following bot?

Microsoft URL Control - 6.00.8862

It has been crawling quite fast through my site and I am curious to know if this is the crawling process for the microsoft search engine.

4:41 am on July 17, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member jdmorgan is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:Mar 31, 2002
posts:25430
votes: 0


akande,

Microsoft URL Control - 6.00.8862 is NOT a Microsoft robot, it is a "control" that allows programs running on Windows to access the web. You might want to check over in the Search Engine Spider Identification forum or do a site search for more info. This user-agent is on many "block lists" as a possible e-mail harvester or site-grabber.

teeceo, I don't think MS will publish their MSNBOT-based index until it is well-tested. So it's going to be awhile, IMO.

Jim

4:46 am on July 17, 2003 (gmt 0)

Moderator This Forum from GB 

WebmasterWorld Administrator mack is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:June 15, 2001
posts:7655
votes: 29


from what I understand Microsoft URL Control is a bad bot typicaly a form mail sniffer.

It is nothing to do with msn search.

The msn search true bot is Msnbot

Ban it in htaccess.

RewriteCond %{HTTP_USER_AGENT} ^microsoft.url [OR]

Mack.

added what jdMorgan said :)

8:20 pm on July 17, 2003 (gmt 0)

Junior Member

10+ Year Member

joined:Mar 22, 2003
posts:64
votes: 0


Thanks for the post replies.
 

Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members