Robot.txt

Where it goes..

[oresam]

Hi, to everyone here... This is my first time here. I dont know much about seo. How can I know if my site has that Robot.txt and do I need it? And if I need it how can I incorporate it to my site. Any help would be appreciated. I just want to know if my site its been indexed by search engines. Thanks

oresam

[mcavill]

The robots.txt file is usually just at the root of your site, so you'd be able to see it if you typed [yourdomain.com...] into your browser.

You only need it if you want to ban bots from folders, such as /cgi-bin/ etc.

there's more info here [robotstxt.org] and here [searchengineworld.com]

You don't need one to be indexed by the searchengines, to see if you've been indexed, just search for www.yourdomain.com and hopefully you'll find your site in the results.

Hope that's of some help, and welcome to WebmasterWorld!

[oresam]

Thanks! MCavill for your help. One more? I added the meta tags to my site. Now. How can I know if my site is search engine friendly. Thanks

oresam

[edited by: ThomasB at 12:16 pm (utc) on April 6, 2005]
[edit reason] no signatures, please [/edit]