homepage Welcome to WebmasterWorld Guest from 54.166.110.222
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Visit PubCon.com
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt

Sitemaps, Meta Data, and robots.txt

Forum Charter, Library, Moderated by: goodroi Forum Options: Reset Last Read Pointers

Using a robots.txt is all part of being a good SEO. Be sure to check yours in the robots.txt validator that is available to subscribers.

 
new Subject Messages Started by Last Message
newpost thread iconno robots.txt
 
6textex 5:50 pm on Feb 8, 2005 (gmt 0)
newpost thread iconPlease help me with robots.txt
 
8karantiq 1:18 pm on Feb 8, 2005 (gmt 0)
newpost thread icone-SocietyRobot
  e-SocietyRobot new IP...
2beauzero 5:47 pm on Feb 4, 2005 (gmt 0)
newpost thread iconRobot.txt
  <meta name="Robots" content="index,follow">
4Trojanfx 11:37 pm on Feb 3, 2005 (gmt 0)
newpost thread iconCan I Disallow Domain Hosts?
  I want to disallow spiders from hosts, like foo.mydomain.com
1SoCalSam 7:24 pm on Jan 30, 2005 (gmt 0)
newpost thread iconRobots.txt conundrum!
 
4energylevel 6:36 pm on Jan 30, 2005 (gmt 0)
newpost thread iconHelp I'm trying to get my site on search engines such as google
  Help on how to get your site on search engines such as google
9Mako3 8:32 am on Jan 30, 2005 (gmt 0)
newpost thread iconCorrect way to exclude dynamic pages
  question about differing methods of excluding dynamic pages
8heuristick 6:50 pm on Jan 28, 2005 (gmt 0)
newpost thread iconare the robots.txt examples still valid from WebmasterWorld?
 
1keywordguru 2:59 pm on Jan 28, 2005 (gmt 0)
newpost thread iconSuggestions On 'Low Value' Bots
  Which bots provide little to no value to the web site.
2netcent 6:24 pm on Jan 24, 2005 (gmt 0)
newpost thread iconBlocking a file in the main folder?
 
4Ept103 3:33 am on Jan 23, 2005 (gmt 0)
newpost thread iconrobot.txt needed to be crawled by google?
  bot leaves after not finding one
8thegreatpretender 4:25 pm on Jan 22, 2005 (gmt 0)
newpost thread iconBlocking sherlock
  quick question to confirm format
11Reno 2:03 am on Jan 20, 2005 (gmt 0)
newpost thread iconSearch Engines doesn't work with my robots.txt file
 
2nirpet 10:38 pm on Jan 18, 2005 (gmt 0)
newpost thread icongoogle follows links disallowed
  Have I done something wrong?
5shady 4:54 pm on Jan 18, 2005 (gmt 0)
newpost thread iconPlease clarify this for the last time
  Subfolder, particualr bots exclusion
1damlag 10:12 pm on Jan 11, 2005 (gmt 0)
newpost thread iconexclude subdirectories
 
3seoerer 11:08 pm on Jan 7, 2005 (gmt 0)
newpost thread iconRobot.txt Generator
  should i put the results on my website?
3rj87uk 10:54 am on Jan 6, 2005 (gmt 0)
newpost thread iconNot sure how to handle space character
 
5Jon_King 1:48 am on Jan 6, 2005 (gmt 0)
newpost thread iconProblem of syntax and ordering
 
1esllou 11:50 am on Jan 4, 2005 (gmt 0)
newpost thread iconWill robots.txt affect IE or other browsers?
  A little confuse...
2iProgram 4:34 am on Jan 4, 2005 (gmt 0)
newpost thread iconwhat are the names of the image bots?
  I can't ban them if I don't know their names
8stapel 5:17 pm on Jan 2, 2005 (gmt 0)
newpost thread iconBlocking images folder from spiders
  Good or bad idea?
2twist 10:17 pm on Jan 1, 2005 (gmt 0)
newpost thread iconSudden Increase in robots.txt Hits
 
3Rob_Moore 10:04 pm on Dec 26, 2004 (gmt 0)
newpost thread iconKeeping spiders off co-branded sites
  how to keep spiders from indexing our partner / co-branded sites
4BillingOrchard 9:41 pm on Dec 23, 2004 (gmt 0)
Displaying Page 51 of 71<< Back 1 ... 41 42 43 44 45 46 47 48 49 50 [ 51 ] 52 53 54 55 56 57 58 59 60 ... 71 Next >>
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved