| Welcome to WebmasterWorld Guest from 188.8.131.52 |
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
|Pubcon Platinum Sponsor 2014|
| 11:02 pm on Mar 23, 2001 (gmt 0)|
I don't know, but what does
email@example.com do? I found it on my log!
Please help me.
| 11:23 pm on Mar 23, 2001 (gmt 0)|
Do your part for freedom and democracy. Put this in your robots.txt
| 2:10 am on Mar 24, 2001 (gmt 0)|
thank you, but I guess, I will like to have little bit help over here.
How to make robots.txt in addition, if I want a logging tool that will log *all* the SE Spiders hits - where can I get such a tool (it would be great if some free tool is available).
Can anyone please walk/guide me.....
| 3:10 am on Mar 24, 2001 (gmt 0)|
Take this and copy and paste it into Notepad or any text editor and save it as "robots.txt". Then ftp it into the root of your web.
This is a good start, however you'll want to change the paths for js and css etc to correlate to the structure of your own site.
All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved