homepage Welcome to WebmasterWorld Guest from 54.167.182.81
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt

Sitemaps, Meta Data, and robots.txt

Forum Charter, Library, Moderated by: goodroi Forum Options: Reset Last Read Pointers

Using a robots.txt is all part of being a good SEO. Be sure to check yours in the robots.txt validator that is available to subscribers.

 
new Subject Messages Started by Last Message
newpost thread iconYahoo's robots.txt
  Where is it?
3Nick_W 6:21 am on Sep 7, 2002 (gmt 0)
newpost thread iconA question on robots.txt files
  ~/ghealton/tmp/ or /tmp/ in /~ghealton/robots.txt
3ghealton 4:05 pm on Aug 30, 2002 (gmt 0)
newpost thread iconRobots.txt question
  which engines IGNORE it?
6charon 1:53 pm on Aug 19, 2002 (gmt 0)
newpost thread iconrobots.txt
  Just checking
2hurlimann 6:59 pm on Aug 18, 2002 (gmt 0)
newpost thread iconrobots.txt
  nervous beginner seeks reassurance
5jgar 4:51 pm on Aug 12, 2002 (gmt 0)
newpost thread icongoogle and robots.txt - do I need one?
 
5cheater_copperpot 5:45 am on Aug 7, 2002 (gmt 0)
newpost thread iconRobots.txt for mirror sites
  Anyone have a good one?
7ScottM 10:38 pm on Aug 6, 2002 (gmt 0)
newpost thread iconWildcard blocking of dynamic - robots.txt
  To: GoogleGuy
5Lisa 6:13 am on Jul 31, 2002 (gmt 0)
newpost thread iconRobots.txt exclude file types
 
2Lisa 7:03 am on Jul 29, 2002 (gmt 0)
newpost thread iconRobots.txt
 
5webboy1 12:04 pm on Jul 22, 2002 (gmt 0)
newpost thread iconrobots.txt
  How to make a valid positive list?
5matthias 6:20 am on Jul 9, 2002 (gmt 0)
newpost thread iconGoogle - robots.txt - indexing
 
9Brett_Tabke 9:40 am on Jun 24, 2002 (gmt 0)
newpost thread iconDo I need a robots.txt file for Googlebot to read?
  Will I get indexed by Google if I don't have a robots.txt?
27johnd 10:03 pm on Jun 18, 2002 (gmt 0)
newpost thread iconQuick tip[2] ( 1 2 )
  Check out your robots.txt
31GoogleGuy 12:34 pm on Jun 18, 2002 (gmt 0)
newpost thread iconDo we need robots.txt?
 
21irock 12:17 am on Jun 11, 2002 (gmt 0)
newpost thread iconrobots.txt and subdomains
  how do I block SE's from my subdomains
2onebaldguy 5:51 am on Jun 6, 2002 (gmt 0)
newpost thread iconrobots.txt question
 
2coolshop 2:21 pm on May 31, 2002 (gmt 0)
newpost thread iconUser agent in robots.txt and browscap.ini...
  Why is there a format different?
6Pushycat 11:39 pm on May 30, 2002 (gmt 0)
newpost thread iconrobots.txt -- block one user-agent, allow all others
 
2luma 1:44 am on May 23, 2002 (gmt 0)
newpost thread iconRobot.txt file help
  How to create this file
7beasscr 6:30 pm on May 16, 2002 (gmt 0)
newpost thread iconrobots.txt
  Generates a 404 error in my logs
9zeus 1:52 pm on May 3, 2002 (gmt 0)
newpost thread iconDoes robots.txt override meta tag?
 
8kira 7:12 pm on May 2, 2002 (gmt 0)
newpost thread iconRobots.txt validator updated.
 
7Brett_Tabke 6:48 pm on Apr 19, 2002 (gmt 0)
newpost thread iconWhat is robots.txt syntax
 
22Alec_Doggone 9:07 am on Apr 19, 2002 (gmt 0)
newpost thread iconSubmitting robots.txt to google
  Would google look sooner for it?
17Yidaki 8:19 am on Apr 19, 2002 (gmt 0)
Displaying Page 70 of 72<< Back 1 ... 60 61 62 63 64 65 66 67 68 69 [ 70 ] 71 72 Next >>
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved