homepage Welcome to WebmasterWorld Guest from 54.159.134.239
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Pubcon Platinum Sponsor 2014
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt

Sitemaps, Meta Data, and robots.txt

Forum Charter, Library, Moderated by: goodroi Forum Options: Reset Last Read Pointers

Using a robots.txt is all part of being a good SEO. Be sure to check yours in the robots.txt validator that is available to subscribers.

 
new Subject Messages Started by Last Message
newpost thread iconRobots.txt disallow: /index.php?
  then /index.php?param=example still allowed?
5Yidaki 12:17 pm on Sep 21, 2003 (gmt 0)
newpost thread iconRobots.txt exclusion question
  Robots.txt exclude all but one directory?
4olof_bailey 8:52 pm on Sep 20, 2003 (gmt 0)
newpost thread iconrobots.txt
  Where does it go?
4zoobie 5:58 pm on Sep 19, 2003 (gmt 0)
newpost thread icon404 robots.txt and traffic going down
 
8silverbytes 4:29 pm on Sep 14, 2003 (gmt 0)
newpost thread iconRobots.txt
 
4johnnstacy1 8:19 am on Sep 1, 2003 (gmt 0)
newpost thread iconMore than one Robots.txt per server?
 
18apphoto 6:05 pm on Aug 30, 2003 (gmt 0)
newpost thread iconrobots.txt case sensitive?
 
3the_nerd 7:48 am on Aug 19, 2003 (gmt 0)
newpost thread iconrobots.txt expert question
  Is it possible for robots.txt to disallow all but one page?
4DanielDiGriz 11:38 pm on Aug 16, 2003 (gmt 0)
newpost thread iconquerystrings and robots.txt
 
1driesie 10:06 am on Aug 13, 2003 (gmt 0)
newpost thread iconFav icon and robots.txt
  Do I need these?
7spikedo55 3:49 pm on Aug 12, 2003 (gmt 0)
newpost thread iconrobots.txt - allow folder withing disallowed one
 
3moltar 5:45 am on Aug 10, 2003 (gmt 0)
newpost thread iconrobots.txt Disallow - How much time till its obeyed?
 
6notsleepy 11:17 pm on Aug 6, 2003 (gmt 0)
newpost thread iconrobots.txt syntax question
  Block access to specific file
2bcolflesh 8:19 pm on Aug 2, 2003 (gmt 0)
newpost thread iconRobots.txt on phpbb forums
  it worked! thanks for the tip
1dvduval 1:52 pm on Jul 29, 2003 (gmt 0)
newpost thread iconrobots.txt
  Is this valid
6customdy 5:01 pm on Jul 16, 2003 (gmt 0)
newpost thread iconIs there a "best" robot txt to get all pages ranked?
  What is very best robot txt coding to insure Google spider index all pages?
5EandA 1:13 pm on Jul 13, 2003 (gmt 0)
newpost thread iconReally necessary to add to robots.txt
 
2coolshop 9:54 pm on Jul 4, 2003 (gmt 0)
newpost thread iconrobots.txt file
 
3ktd121 3:14 am on Jul 4, 2003 (gmt 0)
newpost thread iconmeta name = robot
  What does that do?
7aroye 5:57 pm on Jun 30, 2003 (gmt 0)
newpost thread iconScooter 3.3 ignores robots.txt?
  this is ridiculous
6berli 2:39 am on Jun 27, 2003 (gmt 0)
newpost thread iconRobots.txt
  Help please mine is missing?
3peteredmonds 8:37 pm on Jun 25, 2003 (gmt 0)
newpost thread iconRobots.txt
  Huh?
2zoobie 6:52 pm on Jun 19, 2003 (gmt 0)
newpost thread icon"robots"
  What should it be set at?
4kimderella86 6:22 pm on Jun 18, 2003 (gmt 0)
newpost thread iconRobots.txt exclusion for dynamic page
 
2rogerd 9:22 pm on Jun 17, 2003 (gmt 0)
newpost thread iconRobots.txt & How your site is spidered
  Positives of Robots.txt file aside from disallowing bots
4floridadesigns 11:31 pm on Jun 14, 2003 (gmt 0)
Displaying Page 66 of 72<< Back 1 ... 56 57 58 59 60 61 62 63 64 65 [ 66 ] 67 68 69 70 71 72 Next >>
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved