| Welcome to WebmasterWorld Guest from 22.214.171.124 |
register, free tools, login, search, subscribe, help, library, announcements, recent posts, open posts,
|Subscribe to WebmasterWorld|
|Is this done correctly|
| 1:33 pm on Mar 3, 2004 (gmt 0)|
Below I have included my robots.txt file which is at least 3 weeks old and then some log entries from about 5 minuets ago. Why is google spidering these pages?
| 3:00 pm on Mar 3, 2004 (gmt 0)|
Maybe you didn't make your entries case sensitive? In your robots.txt, you have MyList, but the requests are for Mylist.
All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
© Webmaster World 1996-2014 all rights reserved