Forum Moderated by: goodroi
Using a robots.txt is all part of being a good SEO.
| Thread Subject | Messages | Started by | Last Message | ||||
|---|---|---|---|---|---|---|---|
| HTTP 320 URLs, robots.txt and Google I need to remove indexed HTTP 302 Redirect URLs from Google index. |
5 | nabucosound | 12:38 am June 16, 2012 | ||||
| Robots Follow Meta Tag Will nofollow attribute override robots follow meta tag. |
4 | Hoegaarden | 1:20 am June 9, 2012 | ||||
| block ? with robots.txt or htaccess |
3 | zeus | 10:52 pm June 8, 2012 | ||||
| Sitemap Problem: Google shows sitemap URL in results instead of post U |
2 | Lemans | 10:44 pm June 8, 2012 | ||||
| Robots.txt and regular expressions Can they use them? |
10 | jqwan | 7:48 pm June 4, 2012 | ||||
| Mozilla/4.* (Compatible to block or not? |
13 | Seedy | 9:25 pm May 21, 2012 | ||||
| Meta tag Rel="canonical" & double content How to use this? |
15 | textex | 1:59 am May 20, 2012 | ||||
| Robots.txt for canonical preference having dup content issues |
5 | textex | 9:23 am May 19, 2012 | ||||
| Title and Description Meta Tags |
4 | ultrafade | 12:08 am May 17, 2012 | ||||
| 180.x.x.x |
3 | Seedy | 7:47 am May 15, 2012 | ||||
| Crawl time crawlers |
1 | satty | 12:34 pm Apr 28, 2012 | ||||
| No Follow on Redirected Pages Will 'no follow' on prevent transfer of SEO juice on redirected pages? |
5 | ablu272 | 1:40 pm Apr 16, 2012 | ||||
| Sitemap processing changed? |
4 | HitProf | 9:18 pm Apr 4, 2012 | ||||
| Disallow all URLs with ' ' |
25 | danwhitehouse | 3:56 pm Apr 4, 2012 | ||||
| Can't seem to Disallow a Directory Disallow robots.txt robots |
19 | Holygamer | 10:52 pm Mar 20, 2012 | ||||
| More than 60'000 404 error page |
4 | mirkko22 | 9:09 am Mar 14, 2012 | ||||
| when robots get mad |
1 | lucy24 | 7:54 pm Mar 13, 2012 | ||||
| Google Web Preview - images not displaying |
3 | Seedy | 12:15 pm Mar 9, 2012 | ||||
| .ca site ranking above .com site in USA Google is ranking the wrong (international) site for brand searches |
4 | periscopeUP | 1:36 pm Mar 6, 2012 | ||||
| Disallow vs noindex for duplicate content Disallow in robots.txt, or noindex in meta tag for duplicate content |
6 | graeme_p | 9:07 am Mar 6, 2012 | ||||
| languages and sitemaps where to put language specific urls in sitemaps |
4 | Simon_Giddings | 8:32 am Feb 23, 2012 | ||||
| exclude bookingform that is included on pages |
11 | helenp | 12:16 am Feb 12, 2012 | ||||
| Need Help! - no data in WMT - is it robots.txt or https? Something has happened to my search query data, I need help getting it back |
3 | Scarlett1985 | 4:00 am Feb 3, 2012 | ||||
| Google keywords keywords, disallow, user, agent |
8 | cyberdyne | 12:01 pm Jan 15, 2012 | ||||
| How do I stop g bot from crawling directories? |
7 | shazam | 5:38 pm Jan 8, 2012 |
