Forum Moderated by: goodroi
Using a robots.txt is all part of being a good SEO.
| Thread Subject | Messages | Started by | Last Message | ||||
|---|---|---|---|---|---|---|---|
| Robots.txt strategy: allow only good, or disallow individual bad? Should my robots file say "Only google, yahoo, bing" or All are OK except. |
4 | bigtoga | 4:04 pm May 13, 2013 | ||||
| If I changed my site description, could I ruin my spot at the top? #1 search result |
2 | littlecubpanda | 4:15 pm May 9, 2013 | ||||
| to map or not to map |
1 | lucy24 | 10:30 pm Apr 28, 2013 | ||||
| XML Sitemap Generator for 1 million page site looking for a solution |
5 | RichardV | 4:59 pm Apr 28, 2013 | ||||
| Sitemap.xml & Yoast sitemap-index.xml question A website and Wordpress Blog on same domain |
5 | edwardsgs | 3:45 pm Apr 27, 2013 | ||||
| Penalty for updating/adding sitemaps? Google is losing track of sitemap entries |
6 | rstidx | 7:18 pm Apr 11, 2013 | ||||
| How do I block TagIDs? |
6 | shaunm | 6:40 am Apr 11, 2013 | ||||
| NOODP tag Question. Noodp |
3 | 2kegx | 7:54 pm Apr 9, 2013 | ||||
| Robots.txt Disallow Multiple Level Subdomains Can a parent subdomain's robots.txt disallow spiders in a deeper subdomain? |
3 | rmjvol | 9:02 pm Apr 4, 2013 | ||||
| Wrong Lastmod Tag |
3 | shaunm | 11:05 am Mar 27, 2013 | ||||
| Site Titles not taken after 2 months, Descriptions Updated - help After robots.txt issues, google refuses to index Page title changes |
3 | SilentiSonas | 4:25 pm Mar 25, 2013 | ||||
| what is the User-Agent? |
3 | lucy24 | 12:58 pm Mar 24, 2013 | ||||
| A huge number of URL's monitored on GWT Need to remove all of them |
5 | morpheus83 | 4:41 am Mar 20, 2013 | ||||
| trafficbasedwtf |
1 | lucy24 | 11:41 pm Mar 4, 2013 | ||||
| googlebot not get robots.txt robots.txt |
5 | Luka2013 | 1:06 am Mar 2, 2013 | ||||
| Why we use sitem.xml? |
7 | levijoseph | 10:35 am Mar 1, 2013 | ||||
| old Domain re-directed to New, Sitemap still getting read by old profi |
2 | sikkiagarwal | 10:22 am Feb 8, 2013 | ||||
| Multiple Websites block through Robots? |
6 | Mansi_Padhya | 7:14 pm Jan 31, 2013 | ||||
| Google Sucking My Images Up Why Why Why? |
7 | delboy1978uk | 10:50 pm Jan 27, 2013 | ||||
| Can I have multiple sitemap.xml's for Google? multiple sitemaps xml html |
5 | 2kegx | 10:32 am Jan 21, 2013 | ||||
| robots.txt need help |
4 | a4tech | 10:20 pm Jan 15, 2013 | ||||
| Different sitemaps for different categories? Is it a good idea to use different sitemaps for different categories? |
6 | Matticca | 8:28 pm Jan 6, 2013 | ||||
| 301 redirect |
4 | ultrafade | 11:02 am Dec 17, 2012 | ||||
| Meta Tags for PDF files how to set meta tags for pdf files? |
6 | webseosolution | 11:00 pm Dec 12, 2012 | ||||
| How can I block strange URL's? |
8 | IndigoHollow | 5:30 pm Nov 22, 2012 |
