Forum Moderated by: goodroi
Using a robots.txt is all part of being a good SEO.
| Thread Subject | Messages | Started by | Last Message | ||||
|---|---|---|---|---|---|---|---|
| GSite Crawler Soft Plus GsiteCrawler compile the correct format for xml |
2 | Gemini23 | 12:16 pm Feb 9, 2009 | ||||
| Correct way to exclude all dynamic pages under one url? |
3 | jackgordon | 8:55 pm Feb 7, 2009 | ||||
| Duplicate content and NO INDEX duplicate web content |
3 | Dezblanco | 4:05 pm Feb 6, 2009 | ||||
| Did I invent these meta tags or are they official? Odd that many sites now use these tags... |
2 | Ducki | 10:45 am Feb 6, 2009 | ||||
| Wordpress sitemap widget wordpress, widgets,seo |
5 | Manfred | 1:49 pm Feb 4, 2009 | ||||
| Automatic 301 redirect generator for htaccess? site directory changes - many files need moving |
3 | pgp566 | 3:36 pm Feb 2, 2009 | ||||
| Meta Keywords How to write it? |
3 | vicky | 12:29 pm Jan 28, 2009 | ||||
| Index page text not being indexed |
7 | millsy007 | 11:44 am Jan 20, 2009 | ||||
| Help with robots.txt |
2 | rbecking | 12:07 am Jan 20, 2009 | ||||
| Sitemap and Robots File If both have same entry |
5 | vicky | 6:32 am Jan 19, 2009 | ||||
| Keywords in URL The best way to write URL's to include keywords |
3 | calummacd | 3:22 pm Jan 16, 2009 | ||||
| Global "no follow" and discretionary "follow" |
2 | dummiped | 2:34 pm Jan 15, 2009 | ||||
| static mod rewritten URLS Vs. Physical Path in robots.txt Robots.txt static and dynamic urls |
2 | frogz | 9:52 am Jan 14, 2009 | ||||
| sitemap entry in other domain's robots.txt? |
4 | vicky | 2:24 pm Jan 13, 2009 | ||||
| site maps |
2 | Mr_Cat | 3:10 pm Jan 12, 2009 | ||||
| I need information on XML and Html sitemaps I do have question regards site map |
2 | mick_simon | 2:51 pm Jan 12, 2009 | ||||
| robots.txt Disallow query Disallow specific query in Robots.txt |
4 | frogz | 10:35 pm Jan 9, 2009 | ||||
| Robots.txt - Working or not ? |
10 | glennk | 12:15 pm Jan 9, 2009 | ||||
| Blocking bots |
6 | ag_47 | 4:58 am Jan 8, 2009 | ||||
| Indexing and Crawling to Dynamic pages Would google Crawl Dynamic CMS |
3 | mick_simon | 2:55 am Jan 7, 2009 | ||||
| Disallow in Robots against guidelines? |
4 | cgrant | 4:28 pm Jan 6, 2009 | ||||
| How to block this type of URL's |
9 | iCyborg | 9:32 pm Jan 4, 2009 | ||||
| Having Trouble With an Allow Instruction. Trying to adapt an example given by jdMorgan. |
11 | Durnovaria | 1:43 pm Jan 2, 2009 | ||||
| If a dir is disallowed, will a sitemap in a subdir be read? Sitemaps located in non-content directories |
7 | badbadmonkey | 8:45 pm Jan 1, 2009 | ||||
| Disallow pdf |
13 | FiRe | 11:34 am Dec 22, 2008 |
