homepage Welcome to WebmasterWorld Guest from 54.197.171.109
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt

Sitemaps, Meta Data, and robots.txt

Forum Charter, Library, Moderated by: goodroi Forum Options: Reset Last Read Pointers

Using a robots.txt is all part of being a good SEO. Be sure to check yours in the robots.txt validator that is available to subscribers.

 
new Subject Messages Started by Last Message
newpost thread iconReindexing problem with google
 
2algeriano 7:25 pm on Nov 16, 2012 (gmt 0)
newpost thread iconCrawl Errors - How to manage them effectively?
 
10shaunm 10:11 am on Nov 16, 2012 (gmt 0)
newpost thread iconRobot.txt
  what is the use of Robot.txt
4divyarenjudlk 7:35 pm on Nov 7, 2012 (gmt 0)
newpost thread iconDoes Meta Description affect Rankings in 2012 ha Ok 2013?
 
3nikhilrajr 9:03 am on Nov 7, 2012 (gmt 0)
newpost thread iconOrchestr8
  66.35.60.158
1Bewenched 4:03 am on Nov 5, 2012 (gmt 0)
newpost thread iconProduct microformat without reviews
  Still works?
1SabrinaScherer 2:54 pm on Oct 11, 2012 (gmt 0)
newpost thread iconNew Thought to an Old Thread
  Before you reply, read the entire post including the thread link
2Propools 1:34 am on Oct 11, 2012 (gmt 0)
newpost thread iconSite Map Verses Robot Text File
  Nouf Taraman, Text,
2nouftaraman 2:18 am on Oct 9, 2012 (gmt 0)
newpost thread iconMoved: BPImage walker moved
  Post was moved here: http://www.webmasterworld.com/search_engine_spiders/4503671.htm
1System 8:29 pm on Oct 3, 2012 (gmt 0)
newpost thread iconHow to stop google from indexing wordpress blog paginated archive
 
14Abhinav 6:57 am on Oct 3, 2012 (gmt 0)
newpost thread iconHow to block duplicate pages via robots.txt?
 
5hyderali 6:53 am on Oct 3, 2012 (gmt 0)
newpost thread iconHow do I block the homepage ONLY?
  Perhaps an unusual request
81script 6:22 am on Sep 28, 2012 (gmt 0)
newpost thread iconWho to create XML sitemap exclude URL parameter in Xenu's Link Sleuth
  Best practices to using Xenu's Link Sleuth
3rajesh_magar 10:46 am on Sep 25, 2012 (gmt 0)
newpost thread icondisable indexing only for part of the one page
  disabling part of the page to be indexed
1execom99 1:39 pm on Sep 19, 2012 (gmt 0)
newpost thread iconIncorrect Robots.txt URL in server Logs
 
5triggerfinger 7:57 pm on Sep 17, 2012 (gmt 0)
newpost thread iconRobots.txt Was Inaccessible
  Crawl Postponed Because Robots.txt Was Inaccessible
7poojabhatt 4:21 pm on Sep 16, 2012 (gmt 0)
newpost thread iconMoved: In page analytics moved
  Post was moved here: http://www.webmasterworld.com/analytics/4491502.htm
1System 11:25 am on Sep 4, 2012 (gmt 0)
newpost thread iconGoogle Index robots.txt
  google describes the result for the pages blcocked by robots.txt
9webseosolution 5:41 am on Aug 30, 2012 (gmt 0)
newpost thread iconGoogle appears to be ignoring 301'd URLs
  Googlebot indexing site by IP, even though server is set up to 301
13rowan194 6:50 pm on Aug 28, 2012 (gmt 0)
newpost thread iconBlocking sub-domain in robots.txt?
 
5shaunm 10:24 am on Aug 23, 2012 (gmt 0)
newpost thread iconApache: execute "global" php script when robots.txt requested
  Is there a way to make Apache run a script for a load of a particular file?
10rowan194 7:53 pm on Aug 20, 2012 (gmt 0)
newpost thread iconHow do I block a sub-domain?
  How do I block a dub-domain if the sub-domain is a virtual directory?
6shaunm 10:38 am on Aug 17, 2012 (gmt 0)
newpost thread iconDifferent search result for searching single and plural word
 
2bubble 2:43 pm on Aug 13, 2012 (gmt 0)
newpost thread iconGooglebot possibly ignoring robots.txt
 
23Andem 6:27 am on Jul 29, 2012 (gmt 0)
newpost thread iconNoindex vs Disallow within a Sitemap
  What is the use of using Noindex within a Sitemap?
9shaunm 5:28 am on Jul 27, 2012 (gmt 0)
Displaying Page 4 of 71<< Back 1 2 3 [ 4 ] 5 6 7 8 9 10 11 12 13 ... 71 Next >>
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved