Welcome to WebmasterWorld Guest from 54.159.50.111

Forum Moderated by: goodroi

Sitemaps, Meta Data, and robots.txt


Using a robots.txt is all part of being a good SEO. Be sure to check yours in the robots.txt validator that is available to subscribers.

 
Thread SubjectMessagesStarted byLast Message
Robots "follow command."
Whether this command works or makes them leave.
3 1simone 4:38 pm May 2, 2006
how to set joomla robots.txt file
Joomla Robots
2 cafedelmar 4:37 pm Apr 24, 2006
Yahoo Robots Going Crazy
3 belfastboy 7:39 pm Apr 23, 2006
Need Trailing Slash Clarification
8 Israel 11:17 pm Apr 22, 2006
How can I tell not to add any PHP files
3 smartcard 4:17 am Apr 22, 2006
how long for google search engine to work?
7 Dr_JohnM 9:15 pm Apr 21, 2006
PHP includes with robots.txt
will this work?
3 ionchannels 11:45 pm Apr 20, 2006
Caches, Copyrights and Publishing FOREVER
New thoughts
8 Clark 12:18 pm Apr 17, 2006
Duplicate Content
1 Alli 5:01 am Apr 17, 2006
Looking for advice on blocking IP's
Beginners guide needed
5 Vimes 3:13 pm Apr 15, 2006
Why is washingtonpost.com not cached in Google?
3 ppzhao 5:22 pm Apr 10, 2006
User Agent - Image Search
Trying to find the user agent for ask
3 Jamie_uk 3:25 pm Apr 10, 2006
Google gives 404 error on robots.txt
Googlebot not able to find robots.txt
7 Govind_Uppaluri 11:53 am Apr 10, 2006
Keeping bots out of one script
Is this valid?
4 trillianjedi 10:32 am Apr 10, 2006
Robots Validator?
Anyone know of one?
7 thaedge 11:01 pm Apr 5, 2006
how to disallow spider to index one of my subdomain' files?
4 peony 7:44 pm Apr 5, 2006
Sessions & robots - need help
3 zuses 6:54 am Mar 31, 2006
libwww-perl/5.803
what is libwww-perl/5.803
4 evo81 8:12 pm Mar 28, 2006
robots -how to disallow search results
5 zuses 10:53 am Mar 23, 2006
Syntax check robots.txt
There should be atleast 1 disallow line in any Robots.txt.
3 mycutegoddess 10:32 am Mar 17, 2006
robots.txt in PHP Nuke
I need help with create robots.txt in PHP Nuke
2 spediter 2:28 am Mar 16, 2006
What is robots.txt?
Mystery
4 forex 6:01 am Mar 14, 2006
Validating robots.txt
Research on valid robots.txt and usage
4 smitha_ajay 5:18 am Mar 14, 2006
help.robots.txt/external link
disallow external link
7 dennis_oppelt 2:35 am Mar 14, 2006
more on robots and mirror sites
clarify please
3 dennis_oppelt 12:48 am Mar 14, 2006