Forum Moderated by: goodroi
Using a robots.txt is all part of being a good SEO.
| Thread Subject | Messages | Started by | Last Message | ||||
|---|---|---|---|---|---|---|---|
| Disallowing .html/ |
5 | rros | 6:24 pm Aug 26, 2010 | ||||
| Want to Deny Google from Indexing, Crawling My Private Site Google keeps pestering, is my robots text wrong? |
8 | erlandc | 12:59 pm Aug 26, 2010 | ||||
| Robots.txt - Disallow subdomain only |
3 | pavlovapete | 7:30 am Aug 26, 2010 | ||||
| Pages & Google XML Sitemap Worpress Pluggin |
3 | arkain | 12:26 am Aug 17, 2010 | ||||
| Pattern Matching in Robots.txt ! Can someone please clarify a few points for me? |
3 | james22 | 6:22 am Aug 16, 2010 | ||||
| Submitting child sitemaps too alongwith sitemap index file ? sitemap issue for mammoth sites |
4 | OMZen | 2:45 am Aug 14, 2010 | ||||
| Controlling Crawler Access - different options |
4 | Super_Chunk | 9:20 am Aug 9, 2010 | ||||
| GWT, Robots.txt Update Timing How long might it typically take for Google Webmaster Tools to update? |
9 | edgeportals | 7:35 pm Aug 4, 2010 | ||||
| How do you make search engines index ALL the urls in a sitemap file? How do you make search engines index ALL the urls in a sitemap file? |
8 | Vrindavan | 12:45 pm July 23, 2010 | ||||
| What search engines allow you to submit a sitemap file .xml to them ? |
2 | Vrindavan | 3:29 am July 23, 2010 | ||||
| Will New XML Sitemap Format By Google Will Be Adopted By Yahoo & Bing |
4 | webexpert2u | 7:34 am July 22, 2010 | ||||
| Managing XML sitemap by hand. Is bare bones-format suitable? |
4 | Broadway | 7:24 am July 22, 2010 | ||||
| Do I Need 2 Sitemaps? |
2 | ElvisFan | 12:38 pm July 17, 2010 | ||||
| Placing Sitemaps in Robots.txt Do I put all 3? |
4 | jdancing | 7:20 pm July 12, 2010 | ||||
| Wordpress Sitemap with lots of noindex nofollow |
3 | jdancing | 7:15 pm July 12, 2010 | ||||
| Just how important are meta keywords? |
17 | Tom_Cash | 3:52 am July 8, 2010 | ||||
| robots.txt and wildcards robots.txt wildcarda |
7 | chms | 2:08 pm July 7, 2010 | ||||
| One sitemap can cover multiple sites - kinda cool. |
4 | Sgt_Kickaxe | 11:54 am July 6, 2010 | ||||
| Google does not accept my sitemap sitemap google |
6 | windermann | 10:35 am July 3, 2010 | ||||
| remove outdated data from Google cache |
7 | thosecars82 | 11:46 am June 25, 2010 | ||||
| How to validate an xml sitemap |
5 | amythepoet | 11:22 am June 23, 2010 | ||||
| robots.txt / keywords |
5 | cyberdyne | 11:57 pm June 16, 2010 | ||||
| Blogger, Google webmaster tools and Robots text with /search Does this robots.txt blocking matter? |
2 | cmendla | 2:05 pm June 15, 2010 | ||||
| sitemaps, one is .xml and one is .html sitemaps, one is .xml and one is .html |
6 | amythepoet | 12:51 pm June 14, 2010 | ||||
| How to fix crawl errors How to fix crawl errors |
8 | amythepoet | 1:28 pm June 11, 2010 |