homepage Welcome to WebmasterWorld Guest from 54.237.99.131
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Pubcon Platinum Sponsor 2014
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt

Sitemaps, Meta Data, and robots.txt

Forum Charter, Library, Moderated by: goodroi Forum Options: Reset Last Read Pointers

Using a robots.txt is all part of being a good SEO. Be sure to check yours in the robots.txt validator that is available to subscribers.

 
new Subject Messages Started by Last Message
newpost thread iconHow do I create a robot.txt?
 
9palmpal 1:35 pm on Dec 15, 2002 (gmt 0)
newpost thread iconrobots.txt to stop the BAD bots
  There was a past post with the best robots.txt file?
11Googly 11:18 pm on Dec 12, 2002 (gmt 0)
newpost thread iconRobots.txt file
  disallow target_blank
3junior 9:06 am on Dec 5, 2002 (gmt 0)
newpost thread iconrobots.txt
  robots.txt
3darkroom 9:50 am on Dec 3, 2002 (gmt 0)
newpost thread iconrobots.txt and mod_rewrite, meta robots, etc.
 
4Trisha 4:17 am on Nov 30, 2002 (gmt 0)
newpost thread iconrobot.txt syntax
 
7jamesf4218 9:48 am on Nov 25, 2002 (gmt 0)
newpost thread iconAsk Jeeves robots.txt entry
  what UA should be used
3Kerrin 4:40 pm on Nov 7, 2002 (gmt 0)
newpost thread iconlogic check on robots.txt
  will robots.txt properly disallowing a links page prevent link pop penalty?
9wooden 6:47 pm on Nov 5, 2002 (gmt 0)
newpost thread iconWhich robots to exclude
 
8biggles 1:56 am on Nov 4, 2002 (gmt 0)
newpost thread iconrobots.txt validator bug
  The robots.txt validator accepts malformed files (missing User-agent).
4mortenf 11:02 pm on Nov 3, 2002 (gmt 0)
newpost thread iconWhat is a Robots.txt?
 
4Noximus 3:48 pm on Oct 28, 2002 (gmt 0)
newpost thread iconSpider Blocking
  still a bit unclear
3flexsez 7:43 pm on Oct 23, 2002 (gmt 0)
newpost thread iconConfused about robots.txt
  need a little help
2Yamagotchi 3:19 pm on Oct 21, 2002 (gmt 0)
newpost thread iconrobots.txt file question?
  What's this?
3printlist 11:46 am on Oct 9, 2002 (gmt 0)
newpost thread iconRobots code
 
25hollyhats 3:17 pm on Oct 5, 2002 (gmt 0)
newpost thread iconBeginners guide to robots
  Help needed!
6Monkscuba 1:34 pm on Sep 29, 2002 (gmt 0)
newpost thread iconRobots.txt and htaccess
  Script to write these files, is there such a thing?
4mack 12:55 am on Sep 26, 2002 (gmt 0)
newpost thread iconrobots.txt
  how to use robots txt
4jilla 4:27 pm on Sep 22, 2002 (gmt 0)
newpost thread icon302 code and robots.txt
  will google spider check the robots.txt when the server code is 302?
2coco 11:39 am on Sep 10, 2002 (gmt 0)
newpost thread iconGoogle WAP Proxy and robots.txt
 
14carfac 8:10 pm on Sep 7, 2002 (gmt 0)
newpost thread iconYahoo's robots.txt
  Where is it?
3Nick_W 6:21 am on Sep 7, 2002 (gmt 0)
newpost thread iconA question on robots.txt files
  ~/ghealton/tmp/ or /tmp/ in /~ghealton/robots.txt
3ghealton 4:05 pm on Aug 30, 2002 (gmt 0)
newpost thread iconRobots.txt question
  which engines IGNORE it?
6charon 1:53 pm on Aug 19, 2002 (gmt 0)
newpost thread iconrobots.txt
  Just checking
2hurlimann 6:59 pm on Aug 18, 2002 (gmt 0)
newpost thread iconrobots.txt
  nervous beginner seeks reassurance
5jgar 4:51 pm on Aug 12, 2002 (gmt 0)
Displaying Page 69 of 72<< Back 1 ... 59 60 61 62 63 64 65 66 67 68 [ 69 ] 70 71 72 Next >>
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved