Welcome to WebmasterWorld Guest from 54.166.224.46

Forum Moderators: goodroi

Message Too Old, No Replies

Is this enough

     
9:57 am on Feb 2, 2004 (gmt 0)

10+ Year Member



Hi all,

All I have in my robots.txt file is the bit below - is it enough?

Dougie.

User-Agent: *
Disallow:

11:07 am on Feb 2, 2004 (gmt 0)

WebmasterWorld Senior Member trillianjedi is a WebmasterWorld Top Contributor of All Time 10+ Year Member



is it enough?

What is it you want to do?

The robots.txt you have does nothing.

TJ

11:17 am on Feb 2, 2004 (gmt 0)

10+ Year Member



All I want is for every robot for every SE and every directory to visit my website.
11:19 am on Feb 2, 2004 (gmt 0)

WebmasterWorld Senior Member trillianjedi is a WebmasterWorld Top Contributor of All Time 10+ Year Member



All I want is for every robot for every SE and every directory to visit my website.

You can safely just remove your robots.txt file completely in that case.

It's only used for listing search engine spiders that you do *not* want indexing your site.

TJ

11:20 am on Feb 2, 2004 (gmt 0)

WebmasterWorld Senior Member sem4u is a WebmasterWorld Top Contributor of All Time 10+ Year Member



Well all the robots.txt file will do is to prevent certain spiders from visiting your website. At the moment you do allow all, but if you want to be in a directories you will have to submit to them :)
 

Featured Threads

Hot Threads This Week

Hot Threads This Month