Welcome to WebmasterWorld Guest from 18.104.22.168
How to make robots.txt in addition, if I want a logging tool that will log *all* the SE Spiders hits - where can I get such a tool (it would be great if some free tool is available).
Can anyone please walk/guide me.....
Take this and copy and paste it into Notepad or any text editor and save it as "robots.txt". Then ftp it into the root of your web.
This is a good start, however you'll want to change the paths for js and css etc to correlate to the structure of your own site.