Welcome to WebmasterWorld Guest from 54.160.254.203

Forum Moderators: goodroi

Message Too Old, No Replies

Is this enough

     
9:57 am on Feb 2, 2004 (gmt 0)

Junior Member

10+ Year Member

joined:Dec 31, 2003
posts:172
votes: 0


Hi all,

All I have in my robots.txt file is the bit below - is it enough?

Dougie.

User-Agent: *
Disallow:

11:07 am on Feb 2, 2004 (gmt 0)

Senior Member

WebmasterWorld Senior Member trillianjedi is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:Apr 15, 2003
posts:7242
votes: 0


is it enough?

What is it you want to do?

The robots.txt you have does nothing.

TJ

11:17 am on Feb 2, 2004 (gmt 0)

Junior Member

10+ Year Member

joined:Dec 31, 2003
posts:172
votes: 0


All I want is for every robot for every SE and every directory to visit my website.
11:19 am on Feb 2, 2004 (gmt 0)

Senior Member

WebmasterWorld Senior Member trillianjedi is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:Apr 15, 2003
posts:7242
votes: 0


All I want is for every robot for every SE and every directory to visit my website.

You can safely just remove your robots.txt file completely in that case.

It's only used for listing search engine spiders that you do *not* want indexing your site.

TJ

11:20 am on Feb 2, 2004 (gmt 0)

Senior Member

WebmasterWorld Senior Member sem4u is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:Dec 18, 2002
posts:3061
votes: 0


Well all the robots.txt file will do is to prevent certain spiders from visiting your website. At the moment you do allow all, but if you want to be in a directories you will have to submit to them :)