homepage Welcome to WebmasterWorld Guest from 54.204.231.253
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Pubcon Platinum Sponsor 2014
Visit PubCon.com
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt

Sitemaps, Meta Data, and robots.txt

Forum Charter, Library, Moderated by: goodroi Forum Options: Reset Last Read Pointers

Using a robots.txt is all part of being a good SEO. Be sure to check yours in the robots.txt validator that is available to subscribers.

 
new Subject Messages Started by Last Message
newpost thread iconrobots.txt validator bug
  The robots.txt validator accepts malformed files (missing User-agent).
4mortenf 11:02 pm on Nov 3, 2002 (gmt 0)
newpost thread iconWhat is a Robots.txt?
 
4Noximus 3:48 pm on Oct 28, 2002 (gmt 0)
newpost thread iconSpider Blocking
  still a bit unclear
3flexsez 7:43 pm on Oct 23, 2002 (gmt 0)
newpost thread iconConfused about robots.txt
  need a little help
2Yamagotchi 3:19 pm on Oct 21, 2002 (gmt 0)
newpost thread iconrobots.txt file question?
  What's this?
3printlist 11:46 am on Oct 9, 2002 (gmt 0)
newpost thread iconRobots code
 
25hollyhats 3:17 pm on Oct 5, 2002 (gmt 0)
newpost thread iconBeginners guide to robots
  Help needed!
6Monkscuba 1:34 pm on Sep 29, 2002 (gmt 0)
newpost thread iconRobots.txt and htaccess
  Script to write these files, is there such a thing?
4mack 12:55 am on Sep 26, 2002 (gmt 0)
newpost thread iconrobots.txt
  how to use robots txt
4jilla 4:27 pm on Sep 22, 2002 (gmt 0)
newpost thread icon302 code and robots.txt
  will google spider check the robots.txt when the server code is 302?
2coco 11:39 am on Sep 10, 2002 (gmt 0)
newpost thread iconGoogle WAP Proxy and robots.txt
 
14carfac 8:10 pm on Sep 7, 2002 (gmt 0)
newpost thread iconYahoo's robots.txt
  Where is it?
3Nick_W 6:21 am on Sep 7, 2002 (gmt 0)
newpost thread iconA question on robots.txt files
  ~/ghealton/tmp/ or /tmp/ in /~ghealton/robots.txt
3ghealton 4:05 pm on Aug 30, 2002 (gmt 0)
newpost thread iconRobots.txt question
  which engines IGNORE it?
6charon 1:53 pm on Aug 19, 2002 (gmt 0)
newpost thread iconrobots.txt
  Just checking
2hurlimann 6:59 pm on Aug 18, 2002 (gmt 0)
newpost thread iconrobots.txt
  nervous beginner seeks reassurance
5jgar 4:51 pm on Aug 12, 2002 (gmt 0)
newpost thread icongoogle and robots.txt - do I need one?
 
5cheater_copperpot 5:45 am on Aug 7, 2002 (gmt 0)
newpost thread iconRobots.txt for mirror sites
  Anyone have a good one?
7ScottM 10:38 pm on Aug 6, 2002 (gmt 0)
newpost thread iconWildcard blocking of dynamic - robots.txt
  To: GoogleGuy
5Lisa 6:13 am on Jul 31, 2002 (gmt 0)
newpost thread iconRobots.txt exclude file types
 
2Lisa 7:03 am on Jul 29, 2002 (gmt 0)
newpost thread iconRobots.txt
 
5webboy1 12:04 pm on Jul 22, 2002 (gmt 0)
newpost thread iconrobots.txt
  How to make a valid positive list?
5matthias 6:20 am on Jul 9, 2002 (gmt 0)
newpost thread iconGoogle - robots.txt - indexing
 
9Brett_Tabke 9:40 am on Jun 24, 2002 (gmt 0)
newpost thread iconDo I need a robots.txt file for Googlebot to read?
  Will I get indexed by Google if I don't have a robots.txt?
27johnd 10:03 pm on Jun 18, 2002 (gmt 0)
newpost thread iconQuick tip[2] ( 1 2 )
  Check out your robots.txt
31GoogleGuy 12:34 pm on Jun 18, 2002 (gmt 0)
Displaying Page 69 of 71<< Back 1 ... 59 60 61 62 63 64 65 66 67 68 [ 69 ] 70 71 Next >>
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved