Welcome to WebmasterWorld Guest from

Forum Moderators: mack

Message Too Old, No Replies

msn crawling blog and filling error log

It's looking for stuff that ain't there!

11:57 am on Apr 22, 2007 (gmt 0)

Preferred Member

10+ Year Member

joined:Apr 5, 2004
votes: 0

msnbot under is crawling all the wordpress blogs I have, looking for pages that are not there by appending the name of the blog to all the urls - eg:

www.example.com/blog/2007/01/blog name here

Any suggestions on why this would be happening or how to make it stop filling the error log?


Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members