homepage Welcome to WebmasterWorld Guest from 54.205.189.156
register, free tools, login, search, subscribe, help, library, announcements, recent posts, open posts,
Subscribe to WebmasterWorld
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt

Sitemaps, Meta Data, and robots.txt

Forum Charter, Library, Moderated by: goodroi Forum Options: Reset Last Read Pointers

Using a robots.txt is all part of being a good SEO. Be sure to check yours in the robots.txt validator that is available to subscribers.

 
new Subject Messages Started by Last Message
newpost thread iconNew algo about Robots.txt
  Is there any new algo introduced regarding robots.txt?
4Graham_Hans 2:31 am on Aug 7, 2005 (gmt 0)
newpost thread iconDmoz robots.txt
  Is the dmoz.org/world disallowed?
4angiolo 8:05 am on Aug 6, 2005 (gmt 0)
newpost thread iconHow to exclude Oracle Portal Help pages using robots.txt
  Need to exclude Oracle Portal Help Pages from search engines
10atul_iiit 9:12 am on Aug 5, 2005 (gmt 0)
newpost thread iconhttp://<hostname.domainname>/robots.txt is access denied can robots
  Can robots read robots.txt if I get access denied for this file
4atul_iiit 4:25 pm on Aug 4, 2005 (gmt 0)
newpost thread iconWhat's Robot.txt?
  What's the importance of Robot.txt?
3Lowkei 9:02 am on Jul 31, 2005 (gmt 0)
newpost thread iconDon't want to index dynamic pages
  But would it be a mistake to block them?
5chopin2256 2:12 am on Jul 30, 2005 (gmt 0)
newpost thread iconCould 744 permissions on robots.txt cause problems
  all other files are set to 644
5dbar 7:41 pm on Jul 29, 2005 (gmt 0)
newpost thread iconRobots.txt viewable
  viewing the robots.txt file
2eleap 3:27 pm on Jul 27, 2005 (gmt 0)
newpost thread iconHow to exclude a few pages?
 
2jack38 10:25 am on Jul 27, 2005 (gmt 0)
newpost thread iconBlocking a file extension with robots.txt
  Inherited a site with a problem
5abbeyvet 5:45 pm on Jul 26, 2005 (gmt 0)
newpost thread iconHow to avoid getting print-pages indexed?
  What's the best way for Google?
1simczak 3:42 pm on Jul 24, 2005 (gmt 0)
newpost thread iconRobots.txt stops automated link software
 
2jdhuk 11:01 pm on Jul 18, 2005 (gmt 0)
newpost thread iconWhich editor?
  Notepad or editor in UNIX
3Bali_Freak 12:15 pm on Jul 18, 2005 (gmt 0)
newpost thread iconselectively including folders
  that are beneath a folder excluded
2stu2 5:20 am on Jul 17, 2005 (gmt 0)
newpost thread iconWould this work? Robots exclusion or considered cloaking?
 
5dvldvl3 5:11 am on Jul 17, 2005 (gmt 0)
newpost thread iconPreviously Indexed Files-Want To Exclude Now
  RobotsTxt Change
3buview1 12:23 pm on Jul 16, 2005 (gmt 0)
newpost thread iconGoogle only hits robots and index
  Google only hits robots and index
10rostom 3:51 pm on Jul 15, 2005 (gmt 0)
newpost thread iconDisallowing & in url
 
2Wolvereness 2:54 pm on Jul 12, 2005 (gmt 0)
newpost thread iconrobots.txt verses sitemap.html verses OPML file
 
2Neal 8:39 pm on Jul 11, 2005 (gmt 0)
newpost thread iconJust added robots.txt file
 
4soccrt 4:41 am on Jul 11, 2005 (gmt 0)
newpost thread iconblock all except
 
2Radial 9:31 pm on Jul 7, 2005 (gmt 0)
newpost thread iconrobots.txt with? in URL
 
16jozomannen 11:17 am on Jul 6, 2005 (gmt 0)
newpost thread iconHow do i add robot.txt?
 
10genny 4:38 am on Jul 6, 2005 (gmt 0)
newpost thread iconInclude files, spiders, and robots.txt
 
4rottsnroses 11:24 pm on Jul 3, 2005 (gmt 0)
newpost thread iconHow to Stop BecomeBot?
 
12shilmy 3:09 pm on Jun 29, 2005 (gmt 0)
Displaying Page 45 of 71<< Back 1 ... 35 36 37 38 39 40 41 42 43 44 [ 45 ] 46 47 48 49 50 51 52 53 54 ... 71 Next >>
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved