homepage Welcome to WebmasterWorld Guest from 54.226.213.228
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt

Sitemaps, Meta Data, and robots.txt

Forum Charter, Library, Moderated by: goodroi Forum Options: Reset Last Read Pointers

Using a robots.txt is all part of being a good SEO. Be sure to check yours in the robots.txt validator that is available to subscribers.

 
new Subject Messages Started by Last Message
newpost thread iconRobots.txt Content
 
9almo136 11:12 am on Apr 9, 2010 (gmt 0)
newpost thread iconGet my site off bing?
  bing msnbot
11Sunnz 9:04 am on Apr 9, 2010 (gmt 0)
newpost thread icongoogle keeps looking for wrong sitemap
 
5meelosh 4:45 pm on Apr 8, 2010 (gmt 0)
newpost thread iconpagination indexing
  change of pagination style
7abushahin 11:32 am on Apr 2, 2010 (gmt 0)
newpost thread iconHow about these code
 
2abiao 12:09 am on Apr 2, 2010 (gmt 0)
newpost thread iconI had submitted my sitemap to google webmaster but theres a prob
  I had submitted my sitemap to google webmaster but theres a prob
2Amtoj 12:56 pm on Mar 29, 2010 (gmt 0)
newpost thread iconTitle tag options
  Keywords or sentence in title tag
2palimadra 12:01 pm on Mar 27, 2010 (gmt 0)
newpost thread iconMeta refresh and the search engines
 
2seasalt 11:52 am on Mar 27, 2010 (gmt 0)
newpost thread iconHow to stop parameters page from being indexed
 
3thok 9:21 pm on Mar 26, 2010 (gmt 0)
newpost thread iconStopping Voila from indexing
  How to do it
2experienced 10:40 pm on Mar 25, 2010 (gmt 0)
newpost thread iconMoved: In Text Advertising moved
  Post was moved here: http://www.webmasterworld.com/link_development/4105681.htm
1System 12:46 pm on Mar 25, 2010 (gmt 0)
newpost thread icon301 redirect sitemap not indexed -- resolved
 
3mycrystalbridge 1:42 pm on Mar 24, 2010 (gmt 0)
newpost thread iconDuplicate Domain Indexing Issue - Help Needed
 
5OldIrish 1:38 pm on Mar 24, 2010 (gmt 0)
newpost thread iconHow to prevent a WAP site from appearing in Web Results ONLY?
  Can you differentiate between Mobile Search & Web Search?
2shimsand 6:49 pm on Mar 19, 2010 (gmt 0)
newpost thread iconGoogle: bot crawls my site, but search not updated
  Googlebot crawls my site every day, but site changes is not recorded
4kingoslo 12:28 pm on Mar 18, 2010 (gmt 0)
newpost thread iconGoogle Sitemap php
 
2Gemini23 12:22 pm on Mar 18, 2010 (gmt 0)
newpost thread iconThe best way to add uncrawlable links?
  Following on from a post about spider friendly JavaScript for collapsible c
6jonny0000 12:15 pm on Mar 18, 2010 (gmt 0)
newpost thread iconAfter using robots.txt none of the bots are crawling my site! Help
  robots.txt is not working properly
10shamims 12:11 pm on Mar 18, 2010 (gmt 0)
newpost thread iconnofollow tag or prevent robots from visiting /admin page?
  nofollow and robot.txt
3parliamenttutors 7:17 pm on Mar 16, 2010 (gmt 0)
newpost thread iconSEO Friendly Collapsable Content
  There are several SEO friendly ways of displaying collapsable content. Wond
7jonny0000 3:23 pm on Mar 16, 2010 (gmt 0)
newpost thread iconDo these robot.txt's look ok?
 
4Boulder90 1:45 pm on Mar 16, 2010 (gmt 0)
newpost thread iconPersistent Crawl Errors
 
2GameTestLab 2:28 pm on Mar 15, 2010 (gmt 0)
newpost thread iconGoogle cached "disallow all" robots.txt and sitemap re-submit failed
 
2frankruijiang 1:55 pm on Mar 5, 2010 (gmt 0)
newpost thread iconMoved: question of a newbie - Checking Backlinks moved
  Post was moved here: http://www.webmasterworld.com/link_development/4088876.htm
1System 5:45 pm on Feb 27, 2010 (gmt 0)
newpost thread iconKilobytes downloaded per day vs Pages crawled per day
  Kilobytes downloaded per day vs Pages crawled per day
4cocorocks 12:19 pm on Feb 22, 2010 (gmt 0)
Displaying Page 12 of 72<< Back 1 ... 2 3 4 5 6 7 8 9 10 11 [ 12 ] 13 14 15 16 17 18 19 20 21 ... 72 Next >>
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved