Welcome to WebmasterWorld Guest from 54.145.15.88

Forum Moderators: mack

Message Too Old, No Replies

I am about to ban msnbot

crawl delay

     
11:03 pm on Sep 21, 2007 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Mar 6, 2002
posts:1831
votes: 22


They don't respect the crawl delay in robots.txt

Are you experiencing the same?

 

Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members