homepage Welcome to WebmasterWorld Guest from 54.234.60.133
register, free tools, login, search, subscribe, help, library, announcements, recent posts, open posts,
Pubcon Website
Visit PubCon.com
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt

Sitemaps, Meta Data, and robots.txt

Forum Charter, Library, Moderated by: goodroi Forum Options: Reset Last Read Pointers

Using a robots.txt is all part of being a good SEO. Be sure to check yours in the robots.txt validator that is available to subscribers.

 
new Subject Messages Started by Last Message
newpost thread iconBeginners guide to robots
  Help needed!
6Monkscuba 1:34 pm on Sep 29, 2002 (gmt 0)
newpost thread iconRobots.txt and htaccess
  Script to write these files, is there such a thing?
4mack 12:55 am on Sep 26, 2002 (gmt 0)
newpost thread iconrobots.txt
  how to use robots txt
4jilla 4:27 pm on Sep 22, 2002 (gmt 0)
newpost thread icon302 code and robots.txt
  will google spider check the robots.txt when the server code is 302?
2coco 11:39 am on Sep 10, 2002 (gmt 0)
newpost thread iconGoogle WAP Proxy and robots.txt
 
14carfac 8:10 pm on Sep 7, 2002 (gmt 0)
newpost thread iconYahoo's robots.txt
  Where is it?
3Nick_W 6:21 am on Sep 7, 2002 (gmt 0)
newpost thread iconA question on robots.txt files
  ~/ghealton/tmp/ or /tmp/ in /~ghealton/robots.txt
3ghealton 4:05 pm on Aug 30, 2002 (gmt 0)
newpost thread iconRobots.txt question
  which engines IGNORE it?
6charon 1:53 pm on Aug 19, 2002 (gmt 0)
newpost thread iconrobots.txt
  Just checking
2hurlimann 6:59 pm on Aug 18, 2002 (gmt 0)
newpost thread iconrobots.txt
  nervous beginner seeks reassurance
5jgar 4:51 pm on Aug 12, 2002 (gmt 0)
newpost thread icongoogle and robots.txt - do I need one?
 
5cheater_copperpot 5:45 am on Aug 7, 2002 (gmt 0)
newpost thread iconRobots.txt for mirror sites
  Anyone have a good one?
7ScottM 10:38 pm on Aug 6, 2002 (gmt 0)
newpost thread iconWildcard blocking of dynamic - robots.txt
  To: GoogleGuy
5Lisa 6:13 am on Jul 31, 2002 (gmt 0)
newpost thread iconRobots.txt exclude file types
 
2Lisa 7:03 am on Jul 29, 2002 (gmt 0)
newpost thread iconRobots.txt
 
5webboy1 12:04 pm on Jul 22, 2002 (gmt 0)
newpost thread iconrobots.txt
  How to make a valid positive list?
5matthias 6:20 am on Jul 9, 2002 (gmt 0)
newpost thread iconGoogle - robots.txt - indexing
 
9Brett_Tabke 9:40 am on Jun 24, 2002 (gmt 0)
newpost thread iconDo I need a robots.txt file for Googlebot to read?
  Will I get indexed by Google if I don't have a robots.txt?
27johnd 10:03 pm on Jun 18, 2002 (gmt 0)
newpost thread iconQuick tip[2] ( 1 2 )
  Check out your robots.txt
31GoogleGuy 12:34 pm on Jun 18, 2002 (gmt 0)
newpost thread iconDo we need robots.txt?
 
21irock 12:17 am on Jun 11, 2002 (gmt 0)
newpost thread iconrobots.txt and subdomains
  how do I block SE's from my subdomains
2onebaldguy 5:51 am on Jun 6, 2002 (gmt 0)
newpost thread iconrobots.txt question
 
2coolshop 2:21 pm on May 31, 2002 (gmt 0)
newpost thread iconUser agent in robots.txt and browscap.ini...
  Why is there a format different?
6Pushycat 11:39 pm on May 30, 2002 (gmt 0)
newpost thread iconrobots.txt -- block one user-agent, allow all others
 
2luma 1:44 am on May 23, 2002 (gmt 0)
newpost thread iconRobot.txt file help
  How to create this file
7beasscr 6:30 pm on May 16, 2002 (gmt 0)
Displaying Page 69 of 71<< Back 1 ... 59 60 61 62 63 64 65 66 67 68 [ 69 ] 70 71 Next >>
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About
© Webmaster World 1996-2014 all rights reserved