homepage Welcome to WebmasterWorld Guest from 54.226.10.234
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Pubcon Platinum Sponsor 2014
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt

Sitemaps, Meta Data, and robots.txt

Forum Charter, Library, Moderated by: goodroi Forum Options: Reset Last Read Pointers

Using a robots.txt is all part of being a good SEO. Be sure to check yours in the robots.txt validator that is available to subscribers.

 
new Subject Messages Started by Last Message
newpost thread iconRobot.txt and Templates
  The <meta>Robot tag in templates, with specific disallow in robot.txt
5juniperwasting 4:12 pm on Mar 11, 2003 (gmt 0)
newpost thread iconMy Robots.txt Screw Up.
  case study in how to kill well performing serps in 1 easy step
5webdevsf 1:45 am on Mar 8, 2003 (gmt 0)
newpost thread iconHow do I apply the robots.txt?
  Seems important and need to know more!
3askjoe 6:24 pm on Mar 7, 2003 (gmt 0)
newpost thread iconI don't want to be listed yet
  Is disabling anonomas access enough?
8currington 9:53 am on Mar 5, 2003 (gmt 0)
newpost thread iconempty robots.txt
  yes or no
6HuhuFruFru 8:32 am on Mar 5, 2003 (gmt 0)
newpost thread iconquestion about an empty robots.txt
 
5HuhuFruFru 8:36 pm on Mar 4, 2003 (gmt 0)
newpost thread iconlogs and robots.txt
 
7tyrojds 7:42 pm on Mar 4, 2003 (gmt 0)
newpost thread iconWhy robots.txt if you want everything indexed?
  Does it even matter?
9Larry_C 3:49 pm on Mar 3, 2003 (gmt 0)
newpost thread iconRobots.txt question
  excluding every folder expect one
5JVB_Mktg 7:54 pm on Mar 2, 2003 (gmt 0)
newpost thread iconLogs show a code 206 with robots.txt
  code 206 - partial content
2nativenewyorker 11:03 pm on Mar 1, 2003 (gmt 0)
newpost thread iconrobots.txt syntax
  spaces or slashes?
3keyplyr 5:14 pm on Feb 27, 2003 (gmt 0)
newpost thread iconStrange Incident with robots.txt
  error code 401
3neh2008 4:57 pm on Feb 17, 2003 (gmt 0)
newpost thread iconrobots.txt to block bots access to images
  got to save bandwidth
4stavs 3:00 pm on Feb 14, 2003 (gmt 0)
newpost thread iconROBOTS.TXT Location
  ROBOTS.TXT Location
4neh2008 5:27 pm on Feb 11, 2003 (gmt 0)
newpost thread iconRobots.txt
  I better get this right...
6JVB_Mktg 4:19 am on Feb 11, 2003 (gmt 0)
newpost thread iconRobots.txt
  How? Sub-Domains
2MarkHutch 8:37 pm on Feb 6, 2003 (gmt 0)
newpost thread iconframes and robots.txt
 
4snowfishin 9:15 pm on Feb 3, 2003 (gmt 0)
newpost thread iconDo proxies and Internet caches respect robots.txt?
 
9Scooter24 12:06 am on Feb 3, 2003 (gmt 0)
newpost thread iconrobots.txt file - what program to write it in?
  I use Frontpage 2002
6Web_Footed_Newbie 4:00 pm on Jan 29, 2003 (gmt 0)
newpost thread iconRobots.txt - What program to use to write?
  I use Frontpage 2002
4Web_Footed_Newbie 3:34 pm on Jan 29, 2003 (gmt 0)
newpost thread iconPotbot not respecting robots.txt
 
3Scooter24 1:59 pm on Jan 24, 2003 (gmt 0)
newpost thread iconrobots.txt and robots meta tag not mutually exclusive?
  robots.txt robots meta tag
4Check6 1:35 pm on Jan 24, 2003 (gmt 0)
newpost thread icon"User-Agent"?
  ...or, just User-Agent ?
13pendanticist 3:22 am on Jan 22, 2003 (gmt 0)
newpost thread iconrobots.txt command to disallow indexing
  I want to only disallows robots to index a specific directory
2wellnesscafe 4:50 am on Jan 18, 2003 (gmt 0)
newpost thread iconQuick question about robots.txt
  Excluding dynamic pages
4TheDave 4:09 am on Jan 15, 2003 (gmt 0)
Displaying Page 68 of 72<< Back 1 ... 58 59 60 61 62 63 64 65 66 67 [ 68 ] 69 70 71 72 Next >>
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved