Forum Moderated by: goodroi
Using a robots.txt is all part of being a good SEO.
| Thread Subject | Messages | Started by | Last Message | ||||
|---|---|---|---|---|---|---|---|
| How can I tell not to add any PHP files |
3 | smartcard | 4:17 am Apr 22, 2006 | ||||
| how long for google search engine to work? |
7 | Dr_JohnM | 9:15 pm Apr 21, 2006 | ||||
| PHP includes with robots.txt will this work? |
3 | ionchannels | 11:45 pm Apr 20, 2006 | ||||
| Caches, Copyrights and Publishing FOREVER New thoughts |
8 | Clark | 12:18 pm Apr 17, 2006 | ||||
| Duplicate Content |
1 | Alli | 5:01 am Apr 17, 2006 | ||||
| Looking for advice on blocking IP's Beginners guide needed |
5 | Vimes | 3:13 pm Apr 15, 2006 | ||||
| Why is washingtonpost.com not cached in Google? |
3 | ppzhao | 5:22 pm Apr 10, 2006 | ||||
| User Agent - Image Search Trying to find the user agent for ask |
3 | Jamie_uk | 3:25 pm Apr 10, 2006 | ||||
| Google gives 404 error on robots.txt Googlebot not able to find robots.txt |
7 | Govind_Uppaluri | 11:53 am Apr 10, 2006 | ||||
| Keeping bots out of one script Is this valid? |
4 | trillianjedi | 10:32 am Apr 10, 2006 | ||||
| Robots Validator? Anyone know of one? |
7 | thaedge | 11:01 pm Apr 5, 2006 | ||||
| how to disallow spider to index one of my subdomain' files? |
4 | peony | 7:44 pm Apr 5, 2006 | ||||
| Sessions & robots - need help |
3 | zuses | 6:54 am Mar 31, 2006 | ||||
| libwww-perl/5.803 what is libwww-perl/5.803 |
4 | evo81 | 8:12 pm Mar 28, 2006 | ||||
| robots -how to disallow search results |
5 | zuses | 10:53 am Mar 23, 2006 | ||||
| Syntax check robots.txt There should be atleast 1 disallow line in any Robots.txt. |
3 | mycutegoddess | 10:32 am Mar 17, 2006 | ||||
| robots.txt in PHP Nuke I need help with create robots.txt in PHP Nuke |
2 | spediter | 2:28 am Mar 16, 2006 | ||||
| What is robots.txt? Mystery |
4 | forex | 6:01 am Mar 14, 2006 | ||||
| Validating robots.txt Research on valid robots.txt and usage |
4 | smitha_ajay | 5:18 am Mar 14, 2006 | ||||
| help.robots.txt/external link disallow external link |
7 | dennis_oppelt | 2:35 am Mar 14, 2006 | ||||
| more on robots and mirror sites clarify please |
3 | dennis_oppelt | 12:48 am Mar 14, 2006 | ||||
| robots.txt +ssi+.htaccess |
3 | OldWolf | 5:40 pm Mar 13, 2006 | ||||
| How do I use a wild card for many pages? wild card? |
6 | maha | 1:38 am Mar 12, 2006 | ||||
| Elimination of pages from a website. Do i have to notify the engines in some way? |
9 | Rani | 12:26 am Mar 12, 2006 | ||||
| Robots.txt and htm - html is disallow for htm killing pages that are html? |
5 | chewy | 6:37 pm Mar 8, 2006 |
