homepage Welcome to WebmasterWorld Guest from 23.20.63.27
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Visit PubCon.com
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt

Sitemaps, Meta Data, and robots.txt

Forum Charter, Library, Moderated by: goodroi Forum Options: Reset Last Read Pointers

Using a robots.txt is all part of being a good SEO. Be sure to check yours in the robots.txt validator that is available to subscribers.

 
new Subject Messages Started by Last Message
newpost thread iconrobots.txt
  Where does it go?
1mark1 10:55 pm on Apr 10, 2005 (gmt 0)
newpost thread iconlog entry
  is googlebot coming and going
4Steve_w 9:00 pm on Apr 10, 2005 (gmt 0)
newpost thread iconDisallowing https
  Can this be done via robots.txt?
2yosmc 8:45 pm on Apr 9, 2005 (gmt 0)
newpost thread iconmod_rewrite and robots.txt
  General discussion on use mod_rewrite with robots.txt
7Vaddy 4:34 pm on Apr 7, 2005 (gmt 0)
newpost thread iconNew moderator for robots.txt forum
 
4engine 7:15 pm on Apr 5, 2005 (gmt 0)
newpost thread iconSubdomains and restricted access Web pages
  Search Engine Optimization
2anshul 7:06 pm on Apr 5, 2005 (gmt 0)
newpost thread iconWhat is: "Googles robots NoCache tag" please?
 
4beyondenchanted 8:37 pm on Apr 4, 2005 (gmt 0)
newpost thread iconRobot.txt
  Where it goes..
3oresam 5:06 pm on Apr 4, 2005 (gmt 0)
newpost thread iconBanning googlebot from individual pages via robots.txt
  Meta tags are just not doing the job properly
1Vimes 8:07 am on Mar 31, 2005 (gmt 0)
newpost thread iconWildcards in robots.txt
 
2madmatt69 12:52 am on Mar 31, 2005 (gmt 0)
newpost thread iconBlocking all files with a .ASP extension
  Is this possible with Robots.txt
1marketrevolution 6:21 pm on Mar 30, 2005 (gmt 0)
newpost thread icondisallowing by script variable
 
6wheel 6:30 am on Mar 29, 2005 (gmt 0)
newpost thread iconSyntax help please
 
2jcambert 3:14 am on Mar 29, 2005 (gmt 0)
newpost thread iconSpecifically allow one bot to index a page
  please check my code ;)
5RonPK 10:37 am on Mar 27, 2005 (gmt 0)
newpost thread iconBots using robots
  Do they really have to?
5cooldoug 8:54 pm on Mar 26, 2005 (gmt 0)
newpost thread iconImage disallow
 
2Dexie 1:20 pm on Mar 26, 2005 (gmt 0)
newpost thread iconRobots.txt Question
  Will this cover it?
4rover 5:40 pm on Mar 25, 2005 (gmt 0)
newpost thread iconRobot.txt woes with my mac
  Trouble with robot.txt
4mkfoto 2:21 am on Mar 22, 2005 (gmt 0)
newpost thread iconweb logs Primer
  Looking for general help/information interpreting web site logs
1scrgeek 3:05 pm on Mar 21, 2005 (gmt 0)
newpost thread iconRobots.txt
  Disallowed pages listed
4unperturbed 7:28 pm on Mar 20, 2005 (gmt 0)
newpost thread iconrobots.txt confusion
  question about where to put robots.txt
10SplitPersona 3:13 pm on Mar 17, 2005 (gmt 0)
newpost thread iconexclude vb with robots
 
1johndk 9:55 am on Mar 16, 2005 (gmt 0)
newpost thread iconFilenames have spaces - How to reflect in robots.txt
  Website has filenames that contain spaces. What to do?
4SanDiego_Art 2:54 am on Mar 16, 2005 (gmt 0)
newpost thread iconrestriction for a certain country
  is it possible to do that?
3lucky 8:06 pm on Mar 15, 2005 (gmt 0)
newpost thread iconneed help blocking a site
  not sure if this is possible
11willeffects 5:23 am on Mar 15, 2005 (gmt 0)
Displaying Page 49 of 71<< Back 1 ... 39 40 41 42 43 44 45 46 47 48 [ 49 ] 50 51 52 53 54 55 56 57 58 ... 71 Next >>
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved