homepage Welcome to WebmasterWorld Guest from 54.205.167.187
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt

Sitemaps, Meta Data, and robots.txt

Forum Charter, Library, Moderated by: goodroi Forum Options: Reset Last Read Pointers

Using a robots.txt is all part of being a good SEO. Be sure to check yours in the robots.txt validator that is available to subscribers.

 
new Subject Messages Started by Last Message
newpost thread iconDisallow keyword Ignored?
  Who guarantees me that disallow keyword isn't ignored
5bkausbk 9:02 am on Apr 24, 2005 (gmt 0)
newpost thread iconAllowing and disallowing spiders
  Easy one - can somebody confirm my understanding?
3Zeberdy 9:19 am on Apr 21, 2005 (gmt 0)
newpost thread iconHow to disallow getlastpost
 
2annelisabeth 9:19 am on Apr 21, 2005 (gmt 0)
newpost thread iconRobots.txt Help request.
  I need help with stopping spyder robots.
10westmore 6:22 am on Apr 21, 2005 (gmt 0)
newpost thread iconMeta Descriptions
  How many can I have?
8Andromeda 8:07 pm on Apr 20, 2005 (gmt 0)
newpost thread iconRobots.txt Review
  I need a confirmation for robots.txt from you experts
11RaniaD 11:51 am on Apr 20, 2005 (gmt 0)
newpost thread iconI want to disallow extra for Slurp
  is this syntax right?
2baze22 12:55 pm on Apr 19, 2005 (gmt 0)
newpost thread iconRobots.txt vs Robots META tag
  Does one over-rule the other?
3obsos 7:14 am on Apr 18, 2005 (gmt 0)
newpost thread iconValidation of robots.txt
 
3designei 10:50 am on Apr 17, 2005 (gmt 0)
newpost thread iconHelp w/ robots.txt Google won't toch it
  robots.txt google
2JackieB 11:04 am on Apr 16, 2005 (gmt 0)
newpost thread iconWhat was wrong with this robots.txt if anything
 
4montenegro 9:25 am on Apr 16, 2005 (gmt 0)
newpost thread iconblock cgi bin on a virtual host
  cgi bin is not in root directory
3Reid 6:26 am on Apr 16, 2005 (gmt 0)
newpost thread iconBlock specific words from being indexed
 
13Jer1024 7:34 pm on Apr 15, 2005 (gmt 0)
newpost thread iconAllowing robots to index secure directories in root
 
13naomi 2:46 pm on Apr 14, 2005 (gmt 0)
newpost thread iconBlock certain links
 
2liviu 1:13 pm on Apr 14, 2005 (gmt 0)
newpost thread iconAlexa bot
  Do I NEED robots.txt?
3TheRookie 11:47 pm on Apr 12, 2005 (gmt 0)
newpost thread iconrobots.txt
  Where does it go?
1mark1 10:55 pm on Apr 10, 2005 (gmt 0)
newpost thread iconlog entry
  is googlebot coming and going
4Steve_w 9:00 pm on Apr 10, 2005 (gmt 0)
newpost thread iconDisallowing https
  Can this be done via robots.txt?
2yosmc 8:45 pm on Apr 9, 2005 (gmt 0)
newpost thread iconmod_rewrite and robots.txt
  General discussion on use mod_rewrite with robots.txt
7Vaddy 4:34 pm on Apr 7, 2005 (gmt 0)
newpost thread iconNew moderator for robots.txt forum
 
4engine 7:15 pm on Apr 5, 2005 (gmt 0)
newpost thread iconSubdomains and restricted access Web pages
  Search Engine Optimization
2anshul 7:06 pm on Apr 5, 2005 (gmt 0)
newpost thread iconWhat is: "Googles robots NoCache tag" please?
 
4beyondenchanted 8:37 pm on Apr 4, 2005 (gmt 0)
newpost thread iconRobot.txt
  Where it goes..
3oresam 5:06 pm on Apr 4, 2005 (gmt 0)
newpost thread iconBanning googlebot from individual pages via robots.txt
  Meta tags are just not doing the job properly
1Vimes 8:07 am on Mar 31, 2005 (gmt 0)
Displaying Page 49 of 72<< Back 1 ... 39 40 41 42 43 44 45 46 47 48 [ 49 ] 50 51 52 53 54 55 56 57 58 ... 72 Next >>
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved