Robots.txt Review

I need a confirmation for robots.txt from you experts

[RaniaD]

Hello to all of you! pls as I read the following robot file does not allows the search engines to enter site. Can someone confirm that?

User-agent: *
Disallow: /
Disallow: /Admin/
Disallow: /cmsfiles/
Disallow: /cmsfront/ct_send_ecard.php
Disallow: /flash/
Disallow: /messenger/
Disallow: /phpmailer/
Disallow: /Templates/
Disallow: /weather/
Disallow: /ct_change_image.php
Disallow: /ct_common_functions.php
Disallow: /ct_dir.php

Thank y ou ALL! :)

[ncw164x]

All you need to ban all bots from your site what obey the robots.txt file is this

User-agent: *
Disallow: /

[RaniaD]

Thank you so much ..So i will turn it into

User-agent: *
Disallow:

and all robots will be able to come into my site.

Thank you again

[ncw164x]

yes thats correct

[RaniaD]

;) Cheers

[oddsod]

What about the trailing slash?

[ncw164x]

The first question would of disallowed all robots but thats not what the member wanted to do hence the removal of the trailing slash.

[larryhatch]

Just to confirm:

Is it true, that the following robot.txt permits all robots to all files?

User-agent: *
Disallow:

(note no slash at all). [ ] Yes [ ] NO!

Thanks in advance -Larry

[ncw164x]

Yes this permits all spiders access to your site
User-agent: *
Disallow:

This disallows ALL robots access to your site
User-agent: *
Disallow: /

[SEOViking]

what about just deleting the robots.txt entirely or leaving it blank (no text).

[ncw164x]

yeah having a blank robots.txt file would be another way to permit all spiders to your site

not having the file would leave lots of 404 errors in your sites log file each time the file is requested by a spider but was not available, so IMHO its better to have the file even if it is a blank one