homepage Welcome to WebmasterWorld Guest from 54.227.67.210
register, free tools, login, search, subscribe, help, library, announcements, recent posts, open posts,
Subscribe to WebmasterWorld
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt

Sitemaps, Meta Data, and robots.txt

Forum Charter, Library, Moderated by: goodroi Forum Options: Reset Last Read Pointers

Using a robots.txt is all part of being a good SEO. Be sure to check yours in the robots.txt validator that is available to subscribers.

 
new Subject Messages Started by Last Message
newpost thread iconSubdomains and restricted access Web pages
  Search Engine Optimization
2anshul 7:06 pm on Apr 5, 2005 (gmt 0)
newpost thread iconWhat is: "Googles robots NoCache tag" please?
 
4beyondenchanted 8:37 pm on Apr 4, 2005 (gmt 0)
newpost thread iconRobot.txt
  Where it goes..
3oresam 5:06 pm on Apr 4, 2005 (gmt 0)
newpost thread iconBanning googlebot from individual pages via robots.txt
  Meta tags are just not doing the job properly
1Vimes 8:07 am on Mar 31, 2005 (gmt 0)
newpost thread iconWildcards in robots.txt
 
2madmatt69 12:52 am on Mar 31, 2005 (gmt 0)
newpost thread iconBlocking all files with a .ASP extension
  Is this possible with Robots.txt
1marketrevolution 6:21 pm on Mar 30, 2005 (gmt 0)
newpost thread icondisallowing by script variable
 
6wheel 6:30 am on Mar 29, 2005 (gmt 0)
newpost thread iconSyntax help please
 
2jcambert 3:14 am on Mar 29, 2005 (gmt 0)
newpost thread iconSpecifically allow one bot to index a page
  please check my code ;)
5RonPK 10:37 am on Mar 27, 2005 (gmt 0)
newpost thread iconBots using robots
  Do they really have to?
5cooldoug 8:54 pm on Mar 26, 2005 (gmt 0)
newpost thread iconImage disallow
 
2Dexie 1:20 pm on Mar 26, 2005 (gmt 0)
newpost thread iconRobots.txt Question
  Will this cover it?
4rover 5:40 pm on Mar 25, 2005 (gmt 0)
newpost thread iconRobot.txt woes with my mac
  Trouble with robot.txt
4mkfoto 2:21 am on Mar 22, 2005 (gmt 0)
newpost thread iconweb logs Primer
  Looking for general help/information interpreting web site logs
1scrgeek 3:05 pm on Mar 21, 2005 (gmt 0)
newpost thread iconRobots.txt
  Disallowed pages listed
4unperturbed 7:28 pm on Mar 20, 2005 (gmt 0)
newpost thread iconrobots.txt confusion
  question about where to put robots.txt
10SplitPersona 3:13 pm on Mar 17, 2005 (gmt 0)
newpost thread iconexclude vb with robots
 
1johndk 9:55 am on Mar 16, 2005 (gmt 0)
newpost thread iconFilenames have spaces - How to reflect in robots.txt
  Website has filenames that contain spaces. What to do?
4SanDiego_Art 2:54 am on Mar 16, 2005 (gmt 0)
newpost thread iconrestriction for a certain country
  is it possible to do that?
3lucky 8:06 pm on Mar 15, 2005 (gmt 0)
newpost thread iconneed help blocking a site
  not sure if this is possible
11willeffects 5:23 am on Mar 15, 2005 (gmt 0)
newpost thread iconPriceGrabber UserAgent
 
1driwashsolutions 1:59 am on Mar 15, 2005 (gmt 0)
newpost thread iconcrawl confusion
  Understanding my hits log
5cardpro 8:59 am on Mar 14, 2005 (gmt 0)
newpost thread iconi see the bigger site have the bots not crawling them
  i see the bigger site have the bots not crawling them
2indodpendo 7:12 pm on Mar 13, 2005 (gmt 0)
newpost thread iconim using this sites robits.txt file but my main page gets psa's
  im using this sites robits.txt file but my main page gets psa's
2indodpendo 7:10 pm on Mar 13, 2005 (gmt 0)
newpost thread iconPHP site
  Disallowing pages
3dj_lysuc 12:30 pm on Mar 13, 2005 (gmt 0)
Displaying Page 49 of 71<< Back 1 ... 39 40 41 42 43 44 45 46 47 48 [ 49 ] 50 51 52 53 54 55 56 57 58 ... 71 Next >>
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved