Welcome to WebmasterWorld Guest from 188.8.131.52
Using a robots.txt is all part of being a good SEO. Be sure to check yours in the robots.txt validator that is available to subscribers.
|Thread Subject||Messages||Started by||Last Message|
|How can I tell not to add any PHP files
||3||smartcard||4:17 am Apr 22, 2006|
|how long for google search engine to work?
||7||Dr_JohnM||9:15 pm Apr 21, 2006|
|PHP includes with robots.txt
will this work?
|3||ionchannels||11:45 pm Apr 20, 2006|
|Caches, Copyrights and Publishing FOREVER
|8||Clark||12:18 pm Apr 17, 2006|
||1||Alli||5:01 am Apr 17, 2006|
|Looking for advice on blocking IP's
Beginners guide needed
|5||Vimes||3:13 pm Apr 15, 2006|
|Why is washingtonpost.com not cached in Google?
||3||ppzhao||5:22 pm Apr 10, 2006|
|User Agent - Image Search
Trying to find the user agent for ask
|3||Jamie_uk||3:25 pm Apr 10, 2006|
|Google gives 404 error on robots.txt
Googlebot not able to find robots.txt
|7||Govind_Uppaluri||11:53 am Apr 10, 2006|
|Keeping bots out of one script
Is this valid?
|4||trillianjedi||10:32 am Apr 10, 2006|
Anyone know of one?
|7||thaedge||11:01 pm Apr 5, 2006|
|how to disallow spider to index one of my subdomain' files?
||4||peony||7:44 pm Apr 5, 2006|
|Sessions & robots - need help
||3||zuses||6:54 am Mar 31, 2006|
what is libwww-perl/5.803
|4||evo81||8:12 pm Mar 28, 2006|
|robots -how to disallow search results
||5||zuses||10:53 am Mar 23, 2006|
|Syntax check robots.txt
There should be atleast 1 disallow line in any Robots.txt.
|3||mycutegoddess||10:32 am Mar 17, 2006|
|robots.txt in PHP Nuke
I need help with create robots.txt in PHP Nuke
|2||spediter||2:28 am Mar 16, 2006|
|What is robots.txt?
|4||forex||6:01 am Mar 14, 2006|
Research on valid robots.txt and usage
|4||smitha_ajay||5:18 am Mar 14, 2006|
disallow external link
|7||dennis_oppelt||2:35 am Mar 14, 2006|
|more on robots and mirror sites
|3||dennis_oppelt||12:48 am Mar 14, 2006|
||3||OldWolf||5:40 pm Mar 13, 2006|
|How do I use a wild card for many pages?
|6||maha||1:38 am Mar 12, 2006|
|Elimination of pages from a website.
Do i have to notify the engines in some way?
|9||Rani||12:26 am Mar 12, 2006|
|Robots.txt and htm - html
is disallow for htm killing pages that are html?
|5||chewy||6:37 pm Mar 8, 2006|