homepage Welcome to WebmasterWorld Guest from 54.82.1.136
register, free tools, login, search, subscribe, help, library, announcements, recent posts, open posts,
Pubcon Platinum Sponsor
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt

Sitemaps, Meta Data, and robots.txt

Forum Charter, Library, Moderated by: goodroi Forum Options: Reset Last Read Pointers

Using a robots.txt is all part of being a good SEO. Be sure to check yours in the robots.txt validator that is available to subscribers.

 
new Subject Messages Started by Last Message
newpost thread iconRobots.txt files
  Who to Disallow
6Uniterra 5:08 pm on Mar 1, 2004 (gmt 0)
newpost thread iconHow to disallow doorway pages from indexing?
 
4Voyteck 2:30 pm on Mar 1, 2004 (gmt 0)
newpost thread iconDirectory patterns in query strings
  Will robots.txt block them?
2Wail 8:13 pm on Feb 29, 2004 (gmt 0)
newpost thread iconlist of bots to ban
  it's getting ridiculous but don't want to ban any useful ones
2walkman 4:48 pm on Feb 29, 2004 (gmt 0)
newpost thread iconshould the file .htaccess visible
 
7newbies 3:44 am on Feb 28, 2004 (gmt 0)
newpost thread iconCan I disallow an entire directory but one file?
  too many files to list, plus I'd be advertising them
6walkman 4:13 am on Feb 26, 2004 (gmt 0)
newpost thread iconRobots.txt and Index,nofollow
  do they have to match
4graywolf 10:38 pm on Feb 22, 2004 (gmt 0)
newpost thread iconNew to Robots
  New to Robots
7gotmallz 8:32 pm on Feb 22, 2004 (gmt 0)
newpost thread iconhmmm confused
  this makes no sense
1gotmallz 6:15 am on Feb 22, 2004 (gmt 0)
newpost thread iconConfirm I've done this right please
 
9Essel 5:11 pm on Feb 19, 2004 (gmt 0)
newpost thread iconBanning from the entire webserver?
 
2Essel 5:57 pm on Feb 18, 2004 (gmt 0)
newpost thread iconRobots.txt Error
 
2Takshaka 5:24 pm on Feb 18, 2004 (gmt 0)
newpost thread iconRobots.txt and SERPS
  Blocking serps with robots.txt files and more
2MasterKosmos 6:36 pm on Feb 17, 2004 (gmt 0)
newpost thread iconInktomi Spider Behavior
  what does this mean
5graywolf 12:31 am on Feb 17, 2004 (gmt 0)
newpost thread iconNeed help making robots to block all spiders
 
9budbiss 7:47 pm on Feb 16, 2004 (gmt 0)
newpost thread iconSelective bot blocking
  Scanning rules
2fabfurs 11:43 am on Feb 16, 2004 (gmt 0)
newpost thread iconDo I need to
 
2ronhollin 6:46 am on Feb 16, 2004 (gmt 0)
newpost thread iconHow important is having a properly configured robots?
 
4budbiss 3:45 pm on Feb 14, 2004 (gmt 0)
newpost thread iconDOS Line Enders
  How to download sample robots.txt files
3webman2 10:30 am on Feb 14, 2004 (gmt 0)
newpost thread iconrobots.txt and template pages
  Does blocking templates prevent spiders from following links?
2butterfi 12:59 am on Feb 12, 2004 (gmt 0)
newpost thread icondisallow is allowing
  Is this done correctly?
1DavidAtWork 6:25 pm on Feb 11, 2004 (gmt 0)
newpost thread iconI don't have a robots.txt file..error 404
  Can't get good Google or Yahoo placement
6jagbitsllc 2:17 am on Feb 11, 2004 (gmt 0)
newpost thread iconWebmasterWorldForumBot?
  what is this?
2Trisha 10:33 pm on Feb 10, 2004 (gmt 0)
newpost thread iconHow to stop robots on .php files
 
3djtaverner 6:40 pm on Feb 10, 2004 (gmt 0)
newpost thread iconWhat in the world is a robot.txt?
  I need this to be stated simple for me
5Claudia_T 6:35 pm on Feb 10, 2004 (gmt 0)
Displaying Page 60 of 71<< Back 1 ... 50 51 52 53 54 55 56 57 58 59 [ 60 ] 61 62 63 64 65 66 67 68 69 ... 71 Next >>
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About
© Webmaster World 1996-2014 all rights reserved