homepage Welcome to WebmasterWorld Guest from 54.242.126.126
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt

Sitemaps, Meta Data, and robots.txt

Forum Charter, Library, Moderated by: goodroi Forum Options: Reset Last Read Pointers

Using a robots.txt is all part of being a good SEO. Be sure to check yours in the robots.txt validator that is available to subscribers.

 
new Subject Messages Started by Last Message
newpost thread iconIE "Synchronize Offline while idle" is killing me
  Synchronize Offline
3Helice 12:46 am on Nov 6, 2003 (gmt 0)
newpost thread iconBots ignoring my robots.txt
  In place for a week, validates, but no use
12roddy 7:10 am on Nov 5, 2003 (gmt 0)
newpost thread iconBlocking a spider from a directory
 
3JVB_Mktg 4:30 am on Nov 5, 2003 (gmt 0)
newpost thread iconRobots.txt
  To use... or not to use? That is the question
6panic 1:29 am on Nov 5, 2003 (gmt 0)
newpost thread iconRobots.txt Validator
  We're sorry, this robots.txt does NOT validate.
2midge 12:48 pm on Nov 3, 2003 (gmt 0)
newpost thread iconRobot.txt - What is it, and why use it
 
4laffe 4:36 am on Nov 2, 2003 (gmt 0)
newpost thread iconrobots.txt syntex
  How to block a directory.
6jdancing 7:52 pm on Oct 31, 2003 (gmt 0)
newpost thread iconRobots.txt during development
  Anyone advise on this?
2stuntdubl 3:30 am on Oct 30, 2003 (gmt 0)
newpost thread iconbad Bots
 
3cgj5204 4:40 am on Oct 29, 2003 (gmt 0)
newpost thread iconRestrict Specific Domain Names from Being Indexed
  Using the robots.txt file on Google to restrict certain domains...
3jmh1970 1:36 am on Oct 29, 2003 (gmt 0)
newpost thread iconNew Forum : Robots.txt
 
1Brett_Tabke 9:24 pm on Oct 28, 2003 (gmt 0)
newpost thread iconPut your robots.txt on a diet
  Three easy ways to reduce bloat in robots.txt
20jdMorgan 8:36 pm on Oct 28, 2003 (gmt 0)
newpost thread iconBlocking image file indexing without robots.txt
  Can this be done?
2Winedark 8:08 pm on Oct 28, 2003 (gmt 0)
newpost thread iconRobots.txt size
  How long can a robots.txt be?
4WyrdoManx 9:47 pm on Oct 22, 2003 (gmt 0)
newpost thread iconRobots.txt - Am I Missing Somthing?
  Query strings and general syntax is suspected...
13Nick_W 3:40 pm on Oct 21, 2003 (gmt 0)
newpost thread iconHow to correctly set robots.txt for a subdomain?
  please help
5PatrickDeese 6:36 pm on Oct 15, 2003 (gmt 0)
newpost thread iconRobots.txt for Query Strings
  Can I stop bots from following links with query stings
10Nick_W 6:08 pm on Oct 15, 2003 (gmt 0)
newpost thread iconDMOZ Robots.txt
  Crawling no longer allowed
12Yidaki 5:38 pm on Oct 14, 2003 (gmt 0)
newpost thread iconRobots.txt Question :)
  Question regarding how to use robots txt
8Prana 9:33 pm on Sep 27, 2003 (gmt 0)
newpost thread iconrobots.txt
  3 domains in root
9Alternative_Future 11:33 pm on Sep 23, 2003 (gmt 0)
newpost thread iconRobots.txt disallow: /index.php?
  then /index.php?param=example still allowed?
5Yidaki 12:17 pm on Sep 21, 2003 (gmt 0)
newpost thread iconRobots.txt exclusion question
  Robots.txt exclude all but one directory?
4olof_bailey 8:52 pm on Sep 20, 2003 (gmt 0)
newpost thread iconrobots.txt
  Where does it go?
4zoobie 5:58 pm on Sep 19, 2003 (gmt 0)
newpost thread icon404 robots.txt and traffic going down
 
8silverbytes 4:29 pm on Sep 14, 2003 (gmt 0)
newpost thread iconRobots.txt
 
4johnnstacy1 8:19 am on Sep 1, 2003 (gmt 0)
Displaying Page 65 of 72<< Back 1 ... 55 56 57 58 59 60 61 62 63 64 [ 65 ] 66 67 68 69 70 71 72 Next >>
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved