homepage Welcome to WebmasterWorld Guest from 54.197.147.90
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Visit PubCon.com
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt

Sitemaps, Meta Data, and robots.txt

Forum Charter, Library, Moderated by: goodroi Forum Options: Reset Last Read Pointers

Using a robots.txt is all part of being a good SEO. Be sure to check yours in the robots.txt validator that is available to subscribers.

 
new Subject Messages Started by Last Message
newpost thread iconNo-Follow, allow indexing of a file but not it's links?
 
2JAB_Creations 8:32 am on Apr 27, 2005 (gmt 0)
newpost thread iconHow to stop Yahoo Slurp?
  Slurp ingnores my robots.txt
16atlrus 9:47 pm on Apr 26, 2005 (gmt 0)
newpost thread iconHow to remove ezboard forum from Wayback?
 
3wmw99 12:04 pm on Apr 26, 2005 (gmt 0)
newpost thread iconIs there a definitive robots.txt to disallow bad bots
  bad bots and bad bots only
6Clark 11:40 am on Apr 24, 2005 (gmt 0)
newpost thread iconDisallow keyword Ignored?
  Who guarantees me that disallow keyword isn't ignored
5bkausbk 9:02 am on Apr 24, 2005 (gmt 0)
newpost thread iconAllowing and disallowing spiders
  Easy one - can somebody confirm my understanding?
3Zeberdy 9:19 am on Apr 21, 2005 (gmt 0)
newpost thread iconHow to disallow getlastpost
 
2annelisabeth 9:19 am on Apr 21, 2005 (gmt 0)
newpost thread iconRobots.txt Help request.
  I need help with stopping spyder robots.
10westmore 6:22 am on Apr 21, 2005 (gmt 0)
newpost thread iconMeta Descriptions
  How many can I have?
8Andromeda 8:07 pm on Apr 20, 2005 (gmt 0)
newpost thread iconRobots.txt Review
  I need a confirmation for robots.txt from you experts
11RaniaD 11:51 am on Apr 20, 2005 (gmt 0)
newpost thread iconI want to disallow extra for Slurp
  is this syntax right?
2baze22 12:55 pm on Apr 19, 2005 (gmt 0)
newpost thread iconRobots.txt vs Robots META tag
  Does one over-rule the other?
3obsos 7:14 am on Apr 18, 2005 (gmt 0)
newpost thread iconValidation of robots.txt
 
3designei 10:50 am on Apr 17, 2005 (gmt 0)
newpost thread iconHelp w/ robots.txt Google won't toch it
  robots.txt google
2JackieB 11:04 am on Apr 16, 2005 (gmt 0)
newpost thread iconWhat was wrong with this robots.txt if anything
 
4montenegro 9:25 am on Apr 16, 2005 (gmt 0)
newpost thread iconblock cgi bin on a virtual host
  cgi bin is not in root directory
3Reid 6:26 am on Apr 16, 2005 (gmt 0)
newpost thread iconBlock specific words from being indexed
 
13Jer1024 7:34 pm on Apr 15, 2005 (gmt 0)
newpost thread iconAllowing robots to index secure directories in root
 
13naomi 2:46 pm on Apr 14, 2005 (gmt 0)
newpost thread iconBlock certain links
 
2liviu 1:13 pm on Apr 14, 2005 (gmt 0)
newpost thread iconAlexa bot
  Do I NEED robots.txt?
3TheRookie 11:47 pm on Apr 12, 2005 (gmt 0)
newpost thread iconrobots.txt
  Where does it go?
1mark1 10:55 pm on Apr 10, 2005 (gmt 0)
newpost thread iconlog entry
  is googlebot coming and going
4Steve_w 9:00 pm on Apr 10, 2005 (gmt 0)
newpost thread iconDisallowing https
  Can this be done via robots.txt?
2yosmc 8:45 pm on Apr 9, 2005 (gmt 0)
newpost thread iconmod_rewrite and robots.txt
  General discussion on use mod_rewrite with robots.txt
7Vaddy 4:34 pm on Apr 7, 2005 (gmt 0)
newpost thread iconNew moderator for robots.txt forum
 
4engine 7:15 pm on Apr 5, 2005 (gmt 0)
Displaying Page 48 of 71<< Back 1 ... 38 39 40 41 42 43 44 45 46 47 [ 48 ] 49 50 51 52 53 54 55 56 57 ... 71 Next >>
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved