Forum Moderated by: goodroi
Using a robots.txt is all part of being a good SEO.
| Thread Subject | Messages | Started by | Last Message | ||||
|---|---|---|---|---|---|---|---|
| Dmoz robots.txt Is the dmoz.org/world disallowed? |
4 | angiolo | 8:05 am Aug 6, 2005 | ||||
| How to exclude Oracle Portal Help pages using robots.txt Need to exclude Oracle Portal Help Pages from search engines |
10 | atul_iiit | 9:12 am Aug 5, 2005 | ||||
| http://<hostname.domainname>/robots.txt is access denied can robots Can robots read robots.txt if I get access denied for this file |
4 | atul_iiit | 4:25 pm Aug 4, 2005 | ||||
| What's Robot.txt? What's the importance of Robot.txt? |
3 | Lowkei | 9:02 am July 31, 2005 | ||||
| Don't want to index dynamic pages But would it be a mistake to block them? |
5 | chopin2256 | 2:12 am July 30, 2005 | ||||
| Could 744 permissions on robots.txt cause problems all other files are set to 644 |
5 | dbar | 7:41 pm July 29, 2005 | ||||
| Robots.txt viewable viewing the robots.txt file |
2 | eleap | 3:27 pm July 27, 2005 | ||||
| How to exclude a few pages? |
2 | jack38 | 10:25 am July 27, 2005 | ||||
| Blocking a file extension with robots.txt Inherited a site with a problem |
5 | abbeyvet | 5:45 pm July 26, 2005 | ||||
| How to avoid getting print-pages indexed? What's the best way for Google? |
1 | simczak | 3:42 pm July 24, 2005 | ||||
| Robots.txt stops automated link software |
2 | jdhuk | 11:01 pm July 18, 2005 | ||||
| Which editor? Notepad or editor in UNIX |
3 | Bali_Freak | 12:15 pm July 18, 2005 | ||||
| selectively including folders that are beneath a folder excluded |
2 | stu2 | 5:20 am July 17, 2005 | ||||
| Would this work? Robots exclusion or considered cloaking? |
5 | dvldvl3 | 5:11 am July 17, 2005 | ||||
| Previously Indexed Files-Want To Exclude Now RobotsTxt Change |
3 | buview1 | 12:23 pm July 16, 2005 | ||||
| Google only hits robots and index Google only hits robots and index |
10 | rostom | 3:51 pm July 15, 2005 | ||||
| Disallowing & in url |
2 | Wolvereness | 2:54 pm July 12, 2005 | ||||
| robots.txt verses sitemap.html verses OPML file |
2 | Neal | 8:39 pm July 11, 2005 | ||||
| Just added robots.txt file |
4 | soccrt | 4:41 am July 11, 2005 | ||||
| block all except |
2 | Radial | 9:31 pm July 7, 2005 | ||||
| robots.txt with? in URL |
16 | jozomannen | 11:17 am July 6, 2005 | ||||
| How do i add robot.txt? |
10 | genny | 4:38 am July 6, 2005 | ||||
| Include files, spiders, and robots.txt |
4 | rottsnroses | 11:24 pm July 3, 2005 | ||||
| How to Stop BecomeBot? |
12 | shilmy | 3:09 pm June 29, 2005 | ||||
| Google ignoring my robots.txt? |
9 | homesby | 12:17 am June 29, 2005 |
