homepage Welcome to WebmasterWorld Guest from 54.226.93.128
register, free tools, login, search, subscribe, help, library, announcements, recent posts, open posts,
Subscribe to WebmasterWorld
Visit PubCon.com
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt

Sitemaps, Meta Data, and robots.txt

Forum Charter, Library, Moderated by: goodroi Forum Options: Reset Last Read Pointers

Using a robots.txt is all part of being a good SEO. Be sure to check yours in the robots.txt validator that is available to subscribers.

 
new Subject Messages Started by Last Message
newpost thread iconMeta tags and Robots
 
5Buster42 4:48 pm on Feb 9, 2006 (gmt 0)
newpost thread iconCharacter Limit
  Has anyone head of a character limit in robots.txt?
7bumpaw 8:39 am on Feb 9, 2006 (gmt 0)
newpost thread iconIs this Robots.txt OK?
  Please check this robot.txt file
9mzconstruction 11:06 pm on Feb 3, 2006 (gmt 0)
newpost thread iconrobots.txt and SSL
 
3AlpacaAnnie 8:24 am on Feb 3, 2006 (gmt 0)
newpost thread iconAre different User-agent entries needed for versions of similar robot
 
3Ceyx 2:29 am on Feb 1, 2006 (gmt 0)
newpost thread iconRobots list service?
  Looking for a service provider or subscription service
2xbase234 1:41 am on Feb 1, 2006 (gmt 0)
newpost thread iconHow to disallow URLs with parameters?
  "/page-name.php?" or "/page-name.php"
11iProgram 11:34 pm on Jan 31, 2006 (gmt 0)
newpost thread iconThis OK?
 
3TonysDesigns 10:13 pm on Jan 30, 2006 (gmt 0)
newpost thread iconblock robots from images
  robot images
2gb_dev 9:12 pm on Jan 30, 2006 (gmt 0)
newpost thread iconIf my website dont have robots.txt
  robots.txt
7rusmart 8:50 pm on Jan 30, 2006 (gmt 0)
newpost thread iconDuplicate Content in Robots.txt file
 
2palmpal 12:17 am on Jan 30, 2006 (gmt 0)
newpost thread iconTo allow some robots only
 
9GoldenHammer 3:14 pm on Jan 28, 2006 (gmt 0)
newpost thread iconrobots.txt vs htaccess for control
  if the robots.txt is not dependable why not just use htaccess?
6ccubed99 3:39 am on Jan 28, 2006 (gmt 0)
newpost thread iconrobots.txt and htaccess
 
4agradation 11:17 pm on Jan 26, 2006 (gmt 0)
newpost thread iconTypical robots.txt?
  Anybody got a same robots.txt?
11Lit 6:58 pm on Jan 26, 2006 (gmt 0)
newpost thread iconDisallow for sub-domain directory?
 
7palmpal 4:18 pm on Jan 26, 2006 (gmt 0)
newpost thread iconBlocking old pages
 
1Nutter 3:21 pm on Jan 26, 2006 (gmt 0)
newpost thread iconWildcards special syntax for Google
  publish Google unswer about special Google syntax in robots.txt plus examle
2spiral 3:44 am on Jan 26, 2006 (gmt 0)
newpost thread iconSpiders finding you against all odds
 
3Lyndsay 6:49 pm on Jan 23, 2006 (gmt 0)
newpost thread iconyahoo/slurp spidering
  We don't want these pages indexed by yahoo
9latimer 8:28 am on Jan 23, 2006 (gmt 0)
newpost thread iconCorrect way to ban a directory
 
5palmpal 3:18 am on Jan 23, 2006 (gmt 0)
newpost thread iconWWW vs. Non WWW
  Site indexed twice need robot.txt help
3carjocky 4:10 pm on Jan 20, 2006 (gmt 0)
newpost thread iconUnknowingly restricting some directories
 
2estaquieto 4:40 am on Jan 20, 2006 (gmt 0)
newpost thread iconMSNBOT and robots.txt
 
2Impala 4:31 am on Jan 20, 2006 (gmt 0)
newpost thread iconHow-to: robots.txt white-listing with PHP/Apache
 
2encyclo 2:00 pm on Jan 16, 2006 (gmt 0)
Displaying Page 39 of 71<< Back 1 ... 29 30 31 32 33 34 35 36 37 38 [ 39 ] 40 41 42 43 44 45 46 47 48 ... 71 Next >>
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved