homepage Welcome to WebmasterWorld Guest from 54.237.125.89
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt

Sitemaps, Meta Data, and robots.txt

Forum Charter, Library, Moderated by: goodroi Forum Options: Reset Last Read Pointers

Using a robots.txt is all part of being a good SEO. Be sure to check yours in the robots.txt validator that is available to subscribers.

 
new Subject Messages Started by Last Message
newpost thread iconrobots.txt validator warning suggestion
  Missing newlines can cause problems, but in some cases can be detected.
2mortenf 4:42 pm on Apr 25, 2003 (gmt 0)
newpost thread iconDangers of the robots.txt file
  A warning to the amateurs like myself
3joeuz 6:37 am on Apr 23, 2003 (gmt 0)
newpost thread iconRobots.txt
  Stopping robots visiting single dynamic page.
2donovana 2:02 am on Apr 22, 2003 (gmt 0)
newpost thread iconDo search engines cache robots.txt?
 
10trillianjedi 11:18 pm on Apr 16, 2003 (gmt 0)
newpost thread iconSite hacked and robots.txt placed, taken off google.
  robots.txt, hacked, taken off google
3Mohammed 10:43 am on Apr 15, 2003 (gmt 0)
newpost thread iconrobots.txt
  Disallow other URLs for one site.
3spinweb 6:09 pm on Apr 11, 2003 (gmt 0)
newpost thread iconQuestion about simple robots.txt file
 
13nadsab 12:56 pm on Apr 10, 2003 (gmt 0)
newpost thread iconRobots.txt
  Is this valid?
5Alternative_Future 9:52 am on Apr 3, 2003 (gmt 0)
newpost thread iconGet a Robot
  Get the robot file
7Glenn 2:45 pm on Apr 2, 2003 (gmt 0)
newpost thread iconrobots.txt question
 
2deltron23 9:01 pm on Mar 28, 2003 (gmt 0)
newpost thread iconExternal Javascript and bots and robots.txt?
 
2JeremyL 6:07 pm on Mar 12, 2003 (gmt 0)
newpost thread iconRobot.txt and Templates
  The <meta>Robot tag in templates, with specific disallow in robot.txt
5juniperwasting 4:12 pm on Mar 11, 2003 (gmt 0)
newpost thread iconMy Robots.txt Screw Up.
  case study in how to kill well performing serps in 1 easy step
5webdevsf 1:45 am on Mar 8, 2003 (gmt 0)
newpost thread iconHow do I apply the robots.txt?
  Seems important and need to know more!
3askjoe 6:24 pm on Mar 7, 2003 (gmt 0)
newpost thread iconI don't want to be listed yet
  Is disabling anonomas access enough?
8currington 9:53 am on Mar 5, 2003 (gmt 0)
newpost thread iconempty robots.txt
  yes or no
6HuhuFruFru 8:32 am on Mar 5, 2003 (gmt 0)
newpost thread iconquestion about an empty robots.txt
 
5HuhuFruFru 8:36 pm on Mar 4, 2003 (gmt 0)
newpost thread iconlogs and robots.txt
 
7tyrojds 7:42 pm on Mar 4, 2003 (gmt 0)
newpost thread iconWhy robots.txt if you want everything indexed?
  Does it even matter?
9Larry_C 3:49 pm on Mar 3, 2003 (gmt 0)
newpost thread iconRobots.txt question
  excluding every folder expect one
5JVB_Mktg 7:54 pm on Mar 2, 2003 (gmt 0)
newpost thread iconLogs show a code 206 with robots.txt
  code 206 - partial content
2nativenewyorker 11:03 pm on Mar 1, 2003 (gmt 0)
newpost thread iconrobots.txt syntax
  spaces or slashes?
3keyplyr 5:14 pm on Feb 27, 2003 (gmt 0)
newpost thread iconStrange Incident with robots.txt
  error code 401
3neh2008 4:57 pm on Feb 17, 2003 (gmt 0)
newpost thread iconrobots.txt to block bots access to images
  got to save bandwidth
4stavs 3:00 pm on Feb 14, 2003 (gmt 0)
newpost thread iconROBOTS.TXT Location
  ROBOTS.TXT Location
4neh2008 5:27 pm on Feb 11, 2003 (gmt 0)
Displaying Page 67 of 71<< Back 1 ... 57 58 59 60 61 62 63 64 65 66 [ 67 ] 68 69 70 71 Next >>
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved