Forum Moderated by: goodroi
Using a robots.txt is all part of being a good SEO.
| Thread Subject | Messages | Started by | Last Message | ||||
|---|---|---|---|---|---|---|---|
| Reindexing problem with google |
2 | algeriano | 7:25 pm Nov 16, 2012 | ||||
| Crawl Errors - How to manage them effectively? |
10 | shaunm | 10:11 am Nov 16, 2012 | ||||
| Robot.txt what is the use of Robot.txt |
4 | divyarenjudlk | 7:35 pm Nov 7, 2012 | ||||
| Does Meta Description affect Rankings in 2012 ha Ok 2013? |
3 | nikhilrajr | 9:03 am Nov 7, 2012 | ||||
| Orchestr8 66.35.60.158 |
1 | Bewenched | 4:03 am Nov 5, 2012 | ||||
| Product microformat without reviews Still works? |
1 | SabrinaScherer | 2:54 pm Oct 11, 2012 | ||||
| New Thought to an Old Thread Before you reply, read the entire post including the thread link |
2 | Propools | 1:34 am Oct 11, 2012 | ||||
| Site Map Verses Robot Text File Nouf Taraman, Text, |
2 | nouftaraman | 2:18 am Oct 9, 2012 | ||||
| How to stop google from indexing wordpress blog paginated archive |
14 | Abhinav | 6:57 am Oct 3, 2012 | ||||
| How to block duplicate pages via robots.txt? |
5 | hyderali | 6:53 am Oct 3, 2012 | ||||
| How do I block the homepage ONLY? Perhaps an unusual request |
8 | 1script | 6:22 am Sep 28, 2012 | ||||
| Who to create XML sitemap exclude URL parameter in Xenu's Link Sleuth Best practices to using Xenu's Link Sleuth |
3 | rajesh_magar | 10:46 am Sep 25, 2012 | ||||
| disable indexing only for part of the one page disabling part of the page to be indexed |
1 | execom99 | 1:39 pm Sep 19, 2012 | ||||
| Incorrect Robots.txt URL in server Logs |
5 | triggerfinger | 7:57 pm Sep 17, 2012 | ||||
| Robots.txt Was Inaccessible Crawl Postponed Because Robots.txt Was Inaccessible |
7 | poojabhatt | 4:21 pm Sep 16, 2012 | ||||
| Google Index robots.txt google describes the result for the pages blcocked by robots.txt |
9 | webseosolution | 5:41 am Aug 30, 2012 | ||||
| Google appears to be ignoring 301'd URLs Googlebot indexing site by IP, even though server is set up to 301 |
13 | rowan194 | 6:50 pm Aug 28, 2012 | ||||
| Blocking sub-domain in robots.txt? |
5 | shaunm | 10:24 am Aug 23, 2012 | ||||
| Apache: execute "global" php script when robots.txt requested Is there a way to make Apache run a script for a load of a particular file? |
10 | rowan194 | 7:53 pm Aug 20, 2012 | ||||
| How do I block a sub-domain? How do I block a dub-domain if the sub-domain is a virtual directory? |
6 | shaunm | 10:38 am Aug 17, 2012 | ||||
| Different search result for searching single and plural word |
2 | bubble | 2:43 pm Aug 13, 2012 | ||||
| Googlebot possibly ignoring robots.txt |
23 | Andem | 6:27 am Jul 29, 2012 | ||||
| Noindex vs Disallow within a Sitemap What is the use of using Noindex within a Sitemap? |
9 | shaunm | 5:28 am Jul 27, 2012 | ||||
| google duplicate title issue |
7 | jon22 | 10:02 am Jul 6, 2012 | ||||
| ccTLDs and Sitemaps Can I have one XML sitemap for all my ccTLDs? |
3 | shaunm | 9:35 am Jun 25, 2012 |