homepage Welcome to WebmasterWorld Guest from 23.20.61.85
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Pubcon Platinum Sponsor 2014
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt

Sitemaps, Meta Data, and robots.txt

Forum Charter, Library, Moderated by: goodroi Forum Options: Reset Last Read Pointers

Using a robots.txt is all part of being a good SEO. Be sure to check yours in the robots.txt validator that is available to subscribers.

 
new Subject Messages Started by Last Message
newpost thread iconBlocking a spider from a directory
 
3JVB_Mktg 4:30 am on Nov 5, 2003 (gmt 0)
newpost thread iconRobots.txt
  To use... or not to use? That is the question
6panic 1:29 am on Nov 5, 2003 (gmt 0)
newpost thread iconRobots.txt Validator
  We're sorry, this robots.txt does NOT validate.
2midge 12:48 pm on Nov 3, 2003 (gmt 0)
newpost thread iconRobot.txt - What is it, and why use it
 
4laffe 4:36 am on Nov 2, 2003 (gmt 0)
newpost thread iconrobots.txt syntex
  How to block a directory.
6jdancing 7:52 pm on Oct 31, 2003 (gmt 0)
newpost thread iconRobots.txt during development
  Anyone advise on this?
2stuntdubl 3:30 am on Oct 30, 2003 (gmt 0)
newpost thread iconbad Bots
 
3cgj5204 4:40 am on Oct 29, 2003 (gmt 0)
newpost thread iconRestrict Specific Domain Names from Being Indexed
  Using the robots.txt file on Google to restrict certain domains...
3jmh1970 1:36 am on Oct 29, 2003 (gmt 0)
newpost thread iconNew Forum : Robots.txt
 
1Brett_Tabke 9:24 pm on Oct 28, 2003 (gmt 0)
newpost thread iconPut your robots.txt on a diet
  Three easy ways to reduce bloat in robots.txt
20jdMorgan 8:36 pm on Oct 28, 2003 (gmt 0)
newpost thread iconBlocking image file indexing without robots.txt
  Can this be done?
2Winedark 8:08 pm on Oct 28, 2003 (gmt 0)
newpost thread iconRobots.txt size
  How long can a robots.txt be?
4WyrdoManx 9:47 pm on Oct 22, 2003 (gmt 0)
newpost thread iconRobots.txt - Am I Missing Somthing?
  Query strings and general syntax is suspected...
13Nick_W 3:40 pm on Oct 21, 2003 (gmt 0)
newpost thread iconHow to correctly set robots.txt for a subdomain?
  please help
5PatrickDeese 6:36 pm on Oct 15, 2003 (gmt 0)
newpost thread iconRobots.txt for Query Strings
  Can I stop bots from following links with query stings
10Nick_W 6:08 pm on Oct 15, 2003 (gmt 0)
newpost thread iconDMOZ Robots.txt
  Crawling no longer allowed
12Yidaki 5:38 pm on Oct 14, 2003 (gmt 0)
newpost thread iconRobots.txt Question :)
  Question regarding how to use robots txt
8Prana 9:33 pm on Sep 27, 2003 (gmt 0)
newpost thread iconrobots.txt
  3 domains in root
9Alternative_Future 11:33 pm on Sep 23, 2003 (gmt 0)
newpost thread iconRobots.txt disallow: /index.php?
  then /index.php?param=example still allowed?
5Yidaki 12:17 pm on Sep 21, 2003 (gmt 0)
newpost thread iconRobots.txt exclusion question
  Robots.txt exclude all but one directory?
4olof_bailey 8:52 pm on Sep 20, 2003 (gmt 0)
newpost thread iconrobots.txt
  Where does it go?
4zoobie 5:58 pm on Sep 19, 2003 (gmt 0)
newpost thread icon404 robots.txt and traffic going down
 
8silverbytes 4:29 pm on Sep 14, 2003 (gmt 0)
newpost thread iconRobots.txt
 
4johnnstacy1 8:19 am on Sep 1, 2003 (gmt 0)
newpost thread iconMore than one Robots.txt per server?
 
18apphoto 6:05 pm on Aug 30, 2003 (gmt 0)
newpost thread iconrobots.txt case sensitive?
 
3the_nerd 7:48 am on Aug 19, 2003 (gmt 0)
Displaying Page 65 of 72<< Back 1 ... 55 56 57 58 59 60 61 62 63 64 [ 65 ] 66 67 68 69 70 71 72 Next >>
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved