| Welcome to WebmasterWorld Guest from 22.214.171.124 |
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
|Become a Pro Member|
I don't know, but what does
firstname.lastname@example.org do? I found it on my log!
Please help me.
Do your part for freedom and democracy. Put this in your robots.txt
thank you, but I guess, I will like to have little bit help over here.
How to make robots.txt in addition, if I want a logging tool that will log *all* the SE Spiders hits - where can I get such a tool (it would be great if some free tool is available).
Can anyone please walk/guide me.....
Take this and copy and paste it into Notepad or any text editor and save it as "robots.txt". Then ftp it into the root of your web.
This is a good start, however you'll want to change the paths for js and css etc to correlate to the structure of your own site.
All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved