Welcome to WebmasterWorld Guest from 220.127.116.11
Using a robots.txt is all part of being a good SEO. Be sure to check yours in the robots.txt validator that is available to subscribers.
|Thread Subject||Messages||Started by||Last Message|
|robot.txt: Disallow every subdirectory? Allow certain subdirectories?
||3||SwipeTheMagnets||2:24 am Jul 20, 2009|
|Content should be followed by Google not the Links
||5||raj1094||2:01 am Jul 20, 2009|
|www, version not indexed, why?
||5||biztips||8:03 am Jul 14, 2009|
|Garbled pages in Google/Bing cache
||2||jwwceo||1:10 pm Jul 13, 2009|
||6||Gertcher||5:00 am Jul 7, 2009|
|What would Disallow: /? do?
||3||troyid||4:34 am Jul 7, 2009|
|is it necessary to submit a blog sitemap?
nessesary to submit a blog sitemap
|2||abdobasha2004||12:33 pm Jun 29, 2009|
|Should I noindex my site map/s?
I want robots to follow links, but not index the actual site map.
|7||bouncybunny||4:59 am Jun 28, 2009|
|Cache of page shows different url
||2||malky800||1:20 am Jun 26, 2009|
|Robots.txt best way for blocking urls with ? in them?
||2||MrBlack||11:43 pm Jun 21, 2009|
|Google Indexing Nonexistent Files
||20||Tandem||6:34 am Jun 20, 2009|
|Different Results in different browsers
||4||shake10861||8:27 pm Jun 19, 2009|
|Google Search Results Froze in Time.
Can XML sitemap submission lead to Google stop crawling?
|7||cssatsc||5:00 pm Jun 19, 2009|
|Multiple XML Sitemap for geo targeting site
||5||shama_aries||6:26 pm Jun 17, 2009|
|Is Robots.txt Blocking Bots? Click Tracking
Are robots inflating my clicks even though I've blocked them in robots.txt?
|3||suga||7:13 pm Jun 10, 2009|
|Is there an xml sitemap tag to indicate language or country targeted?
||3||silverbytes||6:59 pm Jun 10, 2009|
|Nicely categorized search results - When does this happen?
Do categorized formatted search results depend on XML sitemap submission?
|5||cssatsc||10:44 am Jun 4, 2009|
|Duplicate content issue
wondering how to get around this problem
|15||sdguy||5:18 pm Jun 3, 2009|
|Do you have to resubmit your sitemap to google
when you change your webpage do you need to let
|3||dantech||9:22 pm Jun 2, 2009|
|Title and description and localization - Repetivite penalty or not?
Do you need to mention the locality for each page?
|2||cmendla||11:09 am Jun 2, 2009|
|Multiples Sitemap in Robots.txt
Can I insert a second differently named sitemap.xml in robots.txt?
|4||stephang||9:58 am Jun 1, 2009|
|Sitemaps for large (1 mil+) websites?
||8||DiscoStu||5:47 am May 30, 2009|
|Problem with Wordpress, Feedburner and Sitemaps
Configuring sitemaps for Wordpress & Feedburner
|2||shusterbaby||5:58 am May 27, 2009|
|Where should I place robots.txt?
robots.txt location root directory or subdirectory with redirect 301
|5||cssatsc||7:46 pm May 26, 2009|
|robots.txt help needed
||2||aroon||4:03 pm May 26, 2009|