homepage Welcome to WebmasterWorld Guest from 54.196.159.11
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Visit PubCon.com
Home / Forums Index / Microsoft / Bing Search Engine News
Forum Library, Charter, Moderators: mack

Bing Search Engine News Forum

    
Microsoft crawling websites?
I found a microsoft bot crawling my pages.
akande




msg:1541155
 4:30 am on Jul 17, 2003 (gmt 0)

Does anyone know what microsoft is doing with the following bot?

Microsoft URL Control - 6.00.8862

It has been crawling quite fast through my site and I am curious to know if this is the crawling process for the microsoft search engine.

 

jdMorgan




msg:1541156
 4:41 am on Jul 17, 2003 (gmt 0)

akande,

Microsoft URL Control - 6.00.8862 is NOT a Microsoft robot, it is a "control" that allows programs running on Windows to access the web. You might want to check over in the Search Engine Spider Identification forum or do a site search for more info. This user-agent is on many "block lists" as a possible e-mail harvester or site-grabber.

teeceo, I don't think MS will publish their MSNBOT-based index until it is well-tested. So it's going to be awhile, IMO.

Jim

mack




msg:1541157
 4:46 am on Jul 17, 2003 (gmt 0)

from what I understand Microsoft URL Control is a bad bot typicaly a form mail sniffer.

It is nothing to do with msn search.

The msn search true bot is Msnbot

Ban it in htaccess.

RewriteCond %{HTTP_USER_AGENT} ^microsoft.url [OR]

Mack.

added what jdMorgan said :)

akande




msg:1541158
 8:20 pm on Jul 17, 2003 (gmt 0)

Thanks for the post replies.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Microsoft / Bing Search Engine News
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved