Forum Moderated by: goodroi

Sitemaps, Meta Data, and robots.txt


Using a robots.txt is all part of being a good SEO.

 
Thread SubjectMessagesStarted byLast Message
  Disallowing .html/
5 rros 6:24 pm Aug 26, 2010
  Want to Deny Google from Indexing, Crawling My Private Site
Google keeps pestering, is my robots text wrong?
8 erlandc 12:59 pm Aug 26, 2010
  Robots.txt - Disallow subdomain only
3 pavlovapete 7:30 am Aug 26, 2010
  Pages & Google XML Sitemap Worpress Pluggin
3 arkain 12:26 am Aug 17, 2010
  Pattern Matching in Robots.txt !
Can someone please clarify a few points for me?
3 james22 6:22 am Aug 16, 2010
  Submitting child sitemaps too alongwith sitemap index file ?
sitemap issue for mammoth sites
4 OMZen 2:45 am Aug 14, 2010
  Controlling Crawler Access - different options
4 Super_Chunk 9:20 am Aug 9, 2010
  GWT, Robots.txt Update Timing
How long might it typically take for Google Webmaster Tools to update?
9 edgeportals 7:35 pm Aug 4, 2010
  How do you make search engines index ALL the urls in a sitemap file?
How do you make search engines index ALL the urls in a sitemap file?
8 Vrindavan 12:45 pm July 23, 2010
  What search engines allow you to submit a sitemap file .xml to them ?
2 Vrindavan 3:29 am July 23, 2010
  Will New XML Sitemap Format By Google Will Be Adopted By Yahoo & Bing
4 webexpert2u 7:34 am July 22, 2010
  Managing XML sitemap by hand.
Is bare bones-format suitable?
4 Broadway 7:24 am July 22, 2010
  Do I Need 2 Sitemaps?
2 ElvisFan 12:38 pm July 17, 2010
  Placing Sitemaps in Robots.txt
Do I put all 3?
4 jdancing 7:20 pm July 12, 2010
  Wordpress Sitemap with lots of noindex nofollow
3 jdancing 7:15 pm July 12, 2010
  Just how important are meta keywords?
17 Tom_Cash 3:52 am July 8, 2010
  robots.txt and wildcards
robots.txt wildcarda
7 chms 2:08 pm July 7, 2010
  One sitemap can cover multiple sites - kinda cool.
4 Sgt_Kickaxe 11:54 am July 6, 2010
  Google does not accept my sitemap
sitemap google
6 windermann 10:35 am July 3, 2010
  remove outdated data from Google cache
7 thosecars82 11:46 am June 25, 2010
  How to validate an xml sitemap
5 amythepoet 11:22 am June 23, 2010
  robots.txt / keywords
5 cyberdyne 11:57 pm June 16, 2010
  Blogger, Google webmaster tools and Robots text with /search
Does this robots.txt blocking matter?
2 cmendla 2:05 pm June 15, 2010
  sitemaps, one is .xml and one is .html
sitemaps, one is .xml and one is .html
6 amythepoet 12:51 pm June 14, 2010
  How to fix crawl errors
How to fix crawl errors
8 amythepoet 1:28 pm June 11, 2010