Forum Moderated by: goodroi
Using a robots.txt is all part of being a good SEO.
| Thread Subject | Messages | Started by | Last Message | ||||
|---|---|---|---|---|---|---|---|
| robots.txt file question? What's this? |
3 | printlist | 11:46 am Oct 9, 2002 | ||||
| Robots code |
25 | hollyhats | 3:17 pm Oct 5, 2002 | ||||
| Beginners guide to robots Help needed! |
6 | Monkscuba | 1:34 pm Sept 29, 2002 | ||||
| Robots.txt and htaccess Script to write these files, is there such a thing? |
4 | mack | 12:55 am Sept 26, 2002 | ||||
| robots.txt how to use robots txt |
4 | jilla | 4:27 pm Sept 22, 2002 | ||||
| 302 code and robots.txt will google spider check the robots.txt when the server code is 302? |
2 | coco | 11:39 am Sept 10, 2002 | ||||
| Google WAP Proxy and robots.txt |
14 | carfac | 8:10 pm Sept 7, 2002 | ||||
| Yahoo's robots.txt Where is it? |
3 | Nick_W | 6:21 am Sept 7, 2002 | ||||
| A question on robots.txt files ~/ghealton/tmp/ or /tmp/ in /~ghealton/robots.txt |
3 | ghealton | 4:05 pm Aug 30, 2002 | ||||
| Robots.txt question which engines IGNORE it? |
6 | charon | 1:53 pm Aug 19, 2002 | ||||
| robots.txt Just checking |
2 | hurlimann | 6:59 pm Aug 18, 2002 | ||||
| robots.txt nervous beginner seeks reassurance |
5 | jgar | 4:51 pm Aug 12, 2002 | ||||
| google and robots.txt - do I need one? |
5 | cheater_copperpot | 5:45 am Aug 7, 2002 | ||||
| Robots.txt for mirror sites Anyone have a good one? |
7 | ScottM | 10:38 pm Aug 6, 2002 | ||||
| Wildcard blocking of dynamic - robots.txt To: GoogleGuy |
5 | Lisa | 6:13 am July 31, 2002 | ||||
| Robots.txt exclude file types |
2 | Lisa | 7:03 am July 29, 2002 | ||||
| Robots.txt |
5 | webboy1 | 12:04 pm July 22, 2002 | ||||
| robots.txt How to make a valid positive list? |
5 | matthias | 6:20 am July 9, 2002 | ||||
| Google - robots.txt - indexing |
9 | Brett_Tabke | 9:40 am June 24, 2002 | ||||
| Do I need a robots.txt file for Googlebot to read? Will I get indexed by Google if I don't have a robots.txt? |
27 | johnd | 10:03 pm June 18, 2002 | ||||
| Quick tip Check out your robots.txt[2] ( 1 2 ) |
31 | GoogleGuy | 12:34 pm June 18, 2002 | ||||
| Do we need robots.txt? |
21 | irock | 12:17 am June 11, 2002 | ||||
| robots.txt and subdomains how do I block SE's from my subdomains |
2 | onebaldguy | 5:51 am June 6, 2002 | ||||
| robots.txt question |
2 | coolshop | 2:21 pm May 31, 2002 | ||||
| User agent in robots.txt and browscap.ini... Why is there a format different? |
6 | Pushycat | 11:39 pm May 30, 2002 |
