homepage Welcome to WebmasterWorld Guest from 54.211.113.223
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Pubcon Platinum Sponsor 2014
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt

Sitemaps, Meta Data, and robots.txt

Forum Charter, Library, Moderated by: goodroi Forum Options: Reset Last Read Pointers

Using a robots.txt is all part of being a good SEO. Be sure to check yours in the robots.txt validator that is available to subscribers.

 
new Subject Messages Started by Last Message
newpost thread iconMore than one Robots.txt per server?
 
18apphoto 6:05 pm on Aug 30, 2003 (gmt 0)
newpost thread iconrobots.txt case sensitive?
 
3the_nerd 7:48 am on Aug 19, 2003 (gmt 0)
newpost thread iconrobots.txt expert question
  Is it possible for robots.txt to disallow all but one page?
4DanielDiGriz 11:38 pm on Aug 16, 2003 (gmt 0)
newpost thread iconquerystrings and robots.txt
 
1driesie 10:06 am on Aug 13, 2003 (gmt 0)
newpost thread iconFav icon and robots.txt
  Do I need these?
7spikedo55 3:49 pm on Aug 12, 2003 (gmt 0)
newpost thread iconrobots.txt - allow folder withing disallowed one
 
3moltar 5:45 am on Aug 10, 2003 (gmt 0)
newpost thread iconrobots.txt Disallow - How much time till its obeyed?
 
6notsleepy 11:17 pm on Aug 6, 2003 (gmt 0)
newpost thread iconrobots.txt syntax question
  Block access to specific file
2bcolflesh 8:19 pm on Aug 2, 2003 (gmt 0)
newpost thread iconRobots.txt on phpbb forums
  it worked! thanks for the tip
1dvduval 1:52 pm on Jul 29, 2003 (gmt 0)
newpost thread iconrobots.txt
  Is this valid
6customdy 5:01 pm on Jul 16, 2003 (gmt 0)
newpost thread iconIs there a "best" robot txt to get all pages ranked?
  What is very best robot txt coding to insure Google spider index all pages?
5EandA 1:13 pm on Jul 13, 2003 (gmt 0)
newpost thread iconReally necessary to add to robots.txt
 
2coolshop 9:54 pm on Jul 4, 2003 (gmt 0)
newpost thread iconrobots.txt file
 
3ktd121 3:14 am on Jul 4, 2003 (gmt 0)
newpost thread iconmeta name = robot
  What does that do?
7aroye 5:57 pm on Jun 30, 2003 (gmt 0)
newpost thread iconScooter 3.3 ignores robots.txt?
  this is ridiculous
6berli 2:39 am on Jun 27, 2003 (gmt 0)
newpost thread iconRobots.txt
  Help please mine is missing?
3peteredmonds 8:37 pm on Jun 25, 2003 (gmt 0)
newpost thread iconRobots.txt
  Huh?
2zoobie 6:52 pm on Jun 19, 2003 (gmt 0)
newpost thread icon"robots"
  What should it be set at?
4kimderella86 6:22 pm on Jun 18, 2003 (gmt 0)
newpost thread iconRobots.txt exclusion for dynamic page
 
2rogerd 9:22 pm on Jun 17, 2003 (gmt 0)
newpost thread iconRobots.txt & How your site is spidered
  Positives of Robots.txt file aside from disallowing bots
4floridadesigns 11:31 pm on Jun 14, 2003 (gmt 0)
newpost thread iconWhy should I obey robots.txt
  Developer questions
22PWalker 1:01 am on Jun 13, 2003 (gmt 0)
newpost thread iconPhp robots.txt parser script
  does that exitst? if not regex help needed.
5ikbenhet1 2:57 pm on Jun 9, 2003 (gmt 0)
newpost thread iconfiles requested by robots.txt
  i would like to find out about the files requested by robots
8andrea_edwards 7:53 pm on Jun 8, 2003 (gmt 0)
newpost thread iconToolbar and Robots.txt
 
8rintrah 8:41 pm on Jun 5, 2003 (gmt 0)
newpost thread iconRobots.txt - files in folders
 
3rintrah 9:43 pm on Jun 4, 2003 (gmt 0)
Displaying Page 66 of 72<< Back 1 ... 56 57 58 59 60 61 62 63 64 65 [ 66 ] 67 68 69 70 71 72 Next >>
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved