Forum Moderated by: goodroi
Using a robots.txt is all part of being a good SEO.
| Thread Subject | Messages | Started by | Last Message | ||||
|---|---|---|---|---|---|---|---|
| URI Only Listing Need a refresher course on this... |
9 | pageoneresults | 12:20 pm Aug 24, 2007 | ||||
| robot.txt Security Can be read publically |
4 | kkonline | 10:08 am Aug 24, 2007 | ||||
| robots.txt="noindex,follow"? |
2 | davidcamus | 9:55 am Aug 24, 2007 | ||||
| how to block a page on a particular location |
7 | experienced | 9:47 am Aug 24, 2007 | ||||
| Multiple "Sitemap: " lines in robots.txt? Several TLDs use same site code / robots.txt. |
2 | geoffyp | 1:33 pm Aug 10, 2007 | ||||
| Baiduspider and multiple user-agent text file. |
4 | Vimes | 12:04 pm Aug 7, 2007 | ||||
| How can you Disallow a Sub-Domain? |
2 | zammo | 10:11 am July 31, 2007 | ||||
| Google Exclude .swf Files How do i exclude swf files from indexing by google |
5 | nxfx | 5:26 pm July 30, 2007 | ||||
| How to disallow entire content, except a particular location |
2 | brakkar | 12:07 pm July 30, 2007 | ||||
| disallowing url midway |
2 | defanjos | 5:20 pm July 29, 2007 | ||||
| Block sub directory |
5 | maxbear | 5:24 am July 28, 2007 | ||||
| Does this work? disallow multiple bots at once... |
3 | Devilfear | 6:48 am July 27, 2007 | ||||
| Using multiple hash marks Does that conform to protocol? |
5 | Reno | 7:17 pm July 25, 2007 | ||||
| Disallowing Iframed pages |
2 | Ozz13 | 1:29 pm July 23, 2007 | ||||
| Proper format for disallow of URL |
4 | Ozz13 | 1:14 pm July 23, 2007 | ||||
| What the dilly? |
3 | tonynoriega | 5:39 pm July 18, 2007 | ||||
| Re-instate pages previously blocked sorry for this noob question |
4 | dibbern2 | 11:23 pm July 16, 2007 | ||||
| Broken Links on my web site I have too many broken links |
2 | erdsah88 | 12:47 pm July 16, 2007 | ||||
| "Disallow: //" - error or meaningful? robots.txt crawler error |
5 | sitetruth | 11:58 pm July 11, 2007 | ||||
| BLOX dynamic urls with robots.txt BLOX dynamic urls with robots.txt |
2 | bo0oost | 11:50 am July 11, 2007 | ||||
| Block affiliate tracking but keep the main page in Google |
5 | chubba | 2:26 pm July 9, 2007 | ||||
| We can put sitempp.html to robots.txt? need some advise |
2 | etgsgroup | 12:00 pm July 6, 2007 | ||||
| A question about blocking IP from Nigerians |
2 | rjr686 | 10:56 pm July 3, 2007 | ||||
| Google and cached, obsolete robots.txt |
5 | MamaDawg | 10:59 am July 3, 2007 | ||||
| Idbot IDBOT hammered our site, now banned |
1 | JohnCanyon | 5:21 pm June 29, 2007 |
