Forum Moderated by: goodroi

Sitemaps, Meta Data, and robots.txt


Using a robots.txt is all part of being a good SEO.

 
Thread SubjectMessagesStarted byLast Message
  Disallowing Sub-Domain
2 bobbonew 3:27 pm Aug 27, 2009
  Google not indexing my sites any more
5 Hans0 12:44 pm Aug 27, 2009
  Robots.txt - Disallow: or Disallow: /
16 phred 12:26 pm Aug 27, 2009
  Different information shown in Different Search Engines
2 raj1094 11:47 am Aug 27, 2009
  Sitemaps to Google, Yahoo and Bing, am I missing another one?
5 silverbytes 8:38 am Aug 22, 2009
  Sitemap according to Google guidelines
Sitemap Changes lead to Errors
3 ahdtravel 4:43 am Aug 22, 2009
  Entries to robots.txt added automatically? Help
3 Potsie88 6:47 pm Aug 19, 2009
  Need Sitemap Software that Uses Metadata Tags
search engine sitemap metadata priority tag
3 quack 4:21 pm Aug 17, 2009
  Correctly disallowing only parts of a folder
2 Trax 9:50 pm Aug 16, 2009
  HTML sitemaps for very large sites
3 DiscoStu 6:55 pm Aug 10, 2009
  robots.txt for directories with same name
3 vero 8:25 pm Aug 5, 2009
  Joomla robot.txt file - blocked image directory
my horrible mistake
2 Yangtze 2:31 pm Aug 5, 2009
  How to create sitemap xml's if I have More than 50,000 urls?
create sitemap xml
3 ahdtravel 1:45 pm July 30, 2009
  Please, help with robots.txt
3 abrodski 2:39 pm July 29, 2009
  Robot.txt: Wildcards
2 SwipeTheMagnets 12:54 pm July 28, 2009
  Robots.txt: Overriding Disallow?
Is it possible to override a disallow on a directory on a url level?
3 thatoneguy 6:11 pm July 26, 2009
  Using site maps to circumvent country selection page
2 hansondodge 2:32 pm July 24, 2009
  1 robots.txt across multiple domains, pt. 2
Continuation of 1 robots.txt file across multiple domains
2 EvanDonovan 8:15 pm July 22, 2009
  Proper procedure for robot.txt
2 ahdtravel 8:11 am July 20, 2009
  robot.txt: Disallow every subdirectory? Allow certain subdirectories?
3 SwipeTheMagnets 2:24 am July 20, 2009
  Content should be followed by Google not the Links
5 raj1094 2:01 am July 20, 2009
  www, version not indexed, why?
5 biztips 8:03 am July 14, 2009
  Garbled pages in Google/Bing cache
2 jwwceo 1:10 pm July 13, 2009
  Mobile websites
6 Gertcher 5:00 am July 7, 2009
  What would Disallow: /? do?
3 troyid 4:34 am July 7, 2009