homepage Welcome to WebmasterWorld Guest from 23.20.61.85
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt

Sitemaps, Meta Data, and robots.txt

Forum Charter, Library, Moderated by: goodroi Forum Options: Reset Last Read Pointers

Using a robots.txt is all part of being a good SEO. Be sure to check yours in the robots.txt validator that is available to subscribers.

 
new Subject Messages Started by Last Message
newpost thread iconblock cgi bin on a virtual host
  cgi bin is not in root directory
3Reid 6:26 am on Apr 16, 2005 (gmt 0)
newpost thread iconBlock specific words from being indexed
 
13Jer1024 7:34 pm on Apr 15, 2005 (gmt 0)
newpost thread iconAllowing robots to index secure directories in root
 
13naomi 2:46 pm on Apr 14, 2005 (gmt 0)
newpost thread iconBlock certain links
 
2liviu 1:13 pm on Apr 14, 2005 (gmt 0)
newpost thread iconAlexa bot
  Do I NEED robots.txt?
3TheRookie 11:47 pm on Apr 12, 2005 (gmt 0)
newpost thread iconrobots.txt
  Where does it go?
1mark1 10:55 pm on Apr 10, 2005 (gmt 0)
newpost thread iconlog entry
  is googlebot coming and going
4Steve_w 9:00 pm on Apr 10, 2005 (gmt 0)
newpost thread iconDisallowing https
  Can this be done via robots.txt?
2yosmc 8:45 pm on Apr 9, 2005 (gmt 0)
newpost thread iconmod_rewrite and robots.txt
  General discussion on use mod_rewrite with robots.txt
7Vaddy 4:34 pm on Apr 7, 2005 (gmt 0)
newpost thread iconNew moderator for robots.txt forum
 
4engine 7:15 pm on Apr 5, 2005 (gmt 0)
newpost thread iconSubdomains and restricted access Web pages
  Search Engine Optimization
2anshul 7:06 pm on Apr 5, 2005 (gmt 0)
newpost thread iconWhat is: "Googles robots NoCache tag" please?
 
4beyondenchanted 8:37 pm on Apr 4, 2005 (gmt 0)
newpost thread iconRobot.txt
  Where it goes..
3oresam 5:06 pm on Apr 4, 2005 (gmt 0)
newpost thread iconBanning googlebot from individual pages via robots.txt
  Meta tags are just not doing the job properly
1Vimes 8:07 am on Mar 31, 2005 (gmt 0)
newpost thread iconWildcards in robots.txt
 
2madmatt69 12:52 am on Mar 31, 2005 (gmt 0)
newpost thread iconBlocking all files with a .ASP extension
  Is this possible with Robots.txt
1marketrevolution 6:21 pm on Mar 30, 2005 (gmt 0)
newpost thread icondisallowing by script variable
 
6wheel 6:30 am on Mar 29, 2005 (gmt 0)
newpost thread iconSyntax help please
 
2jcambert 3:14 am on Mar 29, 2005 (gmt 0)
newpost thread iconSpecifically allow one bot to index a page
  please check my code ;)
5RonPK 10:37 am on Mar 27, 2005 (gmt 0)
newpost thread iconBots using robots
  Do they really have to?
5cooldoug 8:54 pm on Mar 26, 2005 (gmt 0)
newpost thread iconImage disallow
 
2Dexie 1:20 pm on Mar 26, 2005 (gmt 0)
newpost thread iconRobots.txt Question
  Will this cover it?
4rover 5:40 pm on Mar 25, 2005 (gmt 0)
newpost thread iconRobot.txt woes with my mac
  Trouble with robot.txt
4mkfoto 2:21 am on Mar 22, 2005 (gmt 0)
newpost thread iconweb logs Primer
  Looking for general help/information interpreting web site logs
1scrgeek 3:05 pm on Mar 21, 2005 (gmt 0)
newpost thread iconRobots.txt
  Disallowed pages listed
4unperturbed 7:28 pm on Mar 20, 2005 (gmt 0)
Displaying Page 49 of 72<< Back 1 ... 39 40 41 42 43 44 45 46 47 48 [ 49 ] 50 51 52 53 54 55 56 57 58 ... 72 Next >>
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved