homepage Welcome to WebmasterWorld Guest from 54.243.23.129
register, free tools, login, search, subscribe, help, library, announcements, recent posts, open posts,
Subscribe to WebmasterWorld

Visit PubCon.com
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt

Sitemaps, Meta Data, and robots.txt

Forum Charter, Library, Moderated by: goodroi Forum Options: Reset Last Read Pointers

Using a robots.txt is all part of being a good SEO. Be sure to check yours in the robots.txt validator that is available to subscribers.

 
new Subject Messages Started by Last Message
newpost thread iconMoved: In Text Advertising moved
  Post was moved here: http://www.webmasterworld.com/link_development/4105681.htm
1System 12:46 pm on Mar 25, 2010 (gmt 0)
newpost thread icon301 redirect sitemap not indexed -- resolved
 
3mycrystalbridge 1:42 pm on Mar 24, 2010 (gmt 0)
newpost thread iconDuplicate Domain Indexing Issue - Help Needed
 
5OldIrish 1:38 pm on Mar 24, 2010 (gmt 0)
newpost thread iconHow to prevent a WAP site from appearing in Web Results ONLY?
  Can you differentiate between Mobile Search & Web Search?
2shimsand 6:49 pm on Mar 19, 2010 (gmt 0)
newpost thread iconGoogle: bot crawls my site, but search not updated
  Googlebot crawls my site every day, but site changes is not recorded
4kingoslo 12:28 pm on Mar 18, 2010 (gmt 0)
newpost thread iconGoogle Sitemap php
 
2Gemini23 12:22 pm on Mar 18, 2010 (gmt 0)
newpost thread iconThe best way to add uncrawlable links?
  Following on from a post about spider friendly JavaScript for collapsible c
6jonny0000 12:15 pm on Mar 18, 2010 (gmt 0)
newpost thread iconAfter using robots.txt none of the bots are crawling my site! Help
  robots.txt is not working properly
10shamims 12:11 pm on Mar 18, 2010 (gmt 0)
newpost thread iconnofollow tag or prevent robots from visiting /admin page?
  nofollow and robot.txt
3parliamenttutors 7:17 pm on Mar 16, 2010 (gmt 0)
newpost thread iconSEO Friendly Collapsable Content
  There are several SEO friendly ways of displaying collapsable content. Wond
7jonny0000 3:23 pm on Mar 16, 2010 (gmt 0)
newpost thread iconDo these robot.txt's look ok?
 
4Boulder90 1:45 pm on Mar 16, 2010 (gmt 0)
newpost thread iconPersistent Crawl Errors
 
2GameTestLab 2:28 pm on Mar 15, 2010 (gmt 0)
newpost thread iconGoogle cached "disallow all" robots.txt and sitemap re-submit failed
 
2frankruijiang 1:55 pm on Mar 5, 2010 (gmt 0)
newpost thread iconMoved: question of a newbie - Checking Backlinks moved
  Post was moved here: http://www.webmasterworld.com/link_development/4088876.htm
1System 5:45 pm on Feb 27, 2010 (gmt 0)
newpost thread iconKilobytes downloaded per day vs Pages crawled per day
  Kilobytes downloaded per day vs Pages crawled per day
4cocorocks 12:19 pm on Feb 22, 2010 (gmt 0)
newpost thread iconRobots.txt google webmasters blogger blogspot help
 
2Jcblue 12:17 pm on Feb 22, 2010 (gmt 0)
newpost thread iconGoogle site map issues when URL contains %3A
  Google is not properly following site map URLs containing a %3A
9KenB 10:36 pm on Feb 21, 2010 (gmt 0)
newpost thread iconConstantly falling indexed pages and organic traffic in Google
  Constantly falling indexed pages and organic traffic in Google
2cocorocks 4:34 pm on Feb 16, 2010 (gmt 0)
newpost thread iconRobots.txt and dynamic pages
 
3seasalt 8:03 am on Feb 14, 2010 (gmt 0)
newpost thread iconDo I need to resubmit a new sitemap for new content?
 
8BitShift 7:47 am on Feb 14, 2010 (gmt 0)
newpost thread iconSWF content and robots.txt
  swf, robots.txt, google index, removal request, sandbox
4rob1m1982 8:11 pm on Feb 12, 2010 (gmt 0)
newpost thread iconYandex bot
  Should I block it?
4maximillianos 3:48 am on Feb 10, 2010 (gmt 0)
newpost thread iconTool to check if multiple URLs are indexed?
 
5DiscoStu 9:25 am on Feb 4, 2010 (gmt 0)
newpost thread icon3 years on: robots-nocontent, noindex, and google ad section start
  Identifying core or non-core content on a page
1brycen 10:24 pm on Feb 3, 2010 (gmt 0)
newpost thread iconSitemap.xml : Hide from Public view?
 
6donna130 2:13 am on Feb 3, 2010 (gmt 0)
Displaying Page 12 of 71<< Back 1 ... 2 3 4 5 6 7 8 9 10 11 [ 12 ] 13 14 15 16 17 18 19 20 21 ... 71 Next >>
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About
© Webmaster World 1996-2014 all rights reserved