homepage Welcome to WebmasterWorld Guest from 54.204.94.228
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt

Sitemaps, Meta Data, and robots.txt

Forum Charter, Library, Moderated by: goodroi Forum Options: Reset Last Read Pointers

Using a robots.txt is all part of being a good SEO. Be sure to check yours in the robots.txt validator that is available to subscribers.

 
new Subject Messages Started by Last Message
newpost thread iconvspider not adhereing to robots.txt
 
6tonynoriega 11:07 pm on Feb 26, 2009 (gmt 0)
newpost thread iconblock dynamic urls with product options using robots.txt?
  How do I?
2circusboy 3:53 pm on Feb 24, 2009 (gmt 0)
newpost thread iconwhy use a robots.txt
 
17tonynoriega 3:49 pm on Feb 23, 2009 (gmt 0)
newpost thread iconCan't succeed in blocking directories in robots txt
  The paths are already in robots txt but google still crawles those pages.
6stephang 6:27 am on Feb 18, 2009 (gmt 0)
newpost thread iconDisallowing Any Link with a Question Mark in it?
  What is the correct way to do this. Is this the best approach?
11bouncybunny 9:28 am on Feb 16, 2009 (gmt 0)
newpost thread iconPermanent 301 redirect to new domain name
  Permanent 301 redirect to new domain name
16Farhan 1:13 am on Feb 16, 2009 (gmt 0)
newpost thread iconrobots and link page
 
1bode 4:46 pm on Feb 15, 2009 (gmt 0)
newpost thread iconXML Sitemap for Blog
  How to create it?
2vicky 11:57 pm on Feb 12, 2009 (gmt 0)
newpost thread iconGSite Crawler
  Soft Plus GsiteCrawler compile the correct format for xml
2Gemini23 12:16 pm on Feb 9, 2009 (gmt 0)
newpost thread iconCorrect way to exclude all dynamic pages under one url?
 
3jackgordon 8:55 pm on Feb 7, 2009 (gmt 0)
newpost thread iconDuplicate content and NO INDEX
  duplicate web content
3Dezblanco 4:05 pm on Feb 6, 2009 (gmt 0)
newpost thread iconDid I invent these meta tags or are they official?
  Odd that many sites now use these tags...
2Ducki 10:45 am on Feb 6, 2009 (gmt 0)
newpost thread iconWordpress sitemap widget
  wordpress, widgets,seo
5Manfred 1:49 pm on Feb 4, 2009 (gmt 0)
newpost thread iconAutomatic 301 redirect generator for htaccess?
  site directory changes - many files need moving
3pgp566 3:36 pm on Feb 2, 2009 (gmt 0)
newpost thread iconMeta Keywords
  How to write it?
3vicky 12:29 pm on Jan 28, 2009 (gmt 0)
newpost thread iconIndex page text not being indexed
 
7millsy007 11:44 am on Jan 20, 2009 (gmt 0)
newpost thread iconHelp with robots.txt
 
2rbecking 12:07 am on Jan 20, 2009 (gmt 0)
newpost thread iconSitemap and Robots File
  If both have same entry
5vicky 6:32 am on Jan 19, 2009 (gmt 0)
newpost thread iconKeywords in URL
  The best way to write URL's to include keywords
3calummacd 3:22 pm on Jan 16, 2009 (gmt 0)
newpost thread iconGlobal "no follow" and discretionary "follow"
 
2dummiped 2:34 pm on Jan 15, 2009 (gmt 0)
newpost thread iconstatic mod rewritten URLS Vs. Physical Path in robots.txt
  Robots.txt static and dynamic urls
2frogz 9:52 am on Jan 14, 2009 (gmt 0)
newpost thread iconsitemap entry in other domain's robots.txt?
 
4vicky 2:24 pm on Jan 13, 2009 (gmt 0)
newpost thread iconsite maps
 
2Mr_Cat 3:10 pm on Jan 12, 2009 (gmt 0)
newpost thread iconI need information on XML and Html sitemaps
  I do have question regards site map
2mick_simon 2:51 pm on Jan 12, 2009 (gmt 0)
newpost thread iconrobots.txt Disallow query
  Disallow specific query in Robots.txt
4frogz 10:35 pm on Jan 9, 2009 (gmt 0)
Displaying Page 20 of 72<< Back 1 ... 10 11 12 13 14 15 16 17 18 19 [ 20 ] 21 22 23 24 25 26 27 28 29 ... 72 Next >>
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved