homepage Welcome to WebmasterWorld Guest from 54.224.79.93
register, login, search, subscribe, help, library, PubCon, announcements, recent posts, open posts,
Subscribe to WebmasterWorld

Visit PubCon.com
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt

Sitemaps, Meta Data, and robots.txt

Forum Charter, Library, Moderated by: goodroi Forum Options: Reset Last Read Pointers

Using a robots.txt is all part of being a good SEO. Be sure to check yours in the robots.txt validator that is available to subscribers.

 
new Subject Messages Started by Last Message
newpost thread icon301 redirect
 
4ultrafade 11:02 am on Dec 17, 2012 (gmt 0)
newpost thread iconMeta Tags for PDF files
  how to set meta tags for pdf files?
6webseosolution 11:00 pm on Dec 12, 2012 (gmt 0)
newpost thread iconHow can I block strange URL's?
 
8IndigoHollow 5:30 pm on Nov 22, 2012 (gmt 0)
newpost thread iconReindexing problem with google
 
2algeriano 7:25 pm on Nov 16, 2012 (gmt 0)
newpost thread iconCrawl Errors - How to manage them effectively?
 
10shaunm 10:11 am on Nov 16, 2012 (gmt 0)
newpost thread iconRobot.txt
  what is the use of Robot.txt
4divyarenjudlk 7:35 pm on Nov 7, 2012 (gmt 0)
newpost thread iconDoes Meta Description affect Rankings in 2012 ha Ok 2013?
 
3nikhilrajr 9:03 am on Nov 7, 2012 (gmt 0)
newpost thread iconOrchestr8
  66.35.60.158
1Bewenched 4:03 am on Nov 5, 2012 (gmt 0)
newpost thread iconProduct microformat without reviews
  Still works?
1SabrinaScherer 2:54 pm on Oct 11, 2012 (gmt 0)
newpost thread iconNew Thought to an Old Thread
  Before you reply, read the entire post including the thread link
2Propools 1:34 am on Oct 11, 2012 (gmt 0)
newpost thread iconSite Map Verses Robot Text File
  Nouf Taraman, Text,
2nouftaraman 2:18 am on Oct 9, 2012 (gmt 0)
newpost thread iconMoved: BPImage walker moved
  Post was moved here: http://www.webmasterworld.com/search_engine_spiders/4503671.htm
1System 8:29 pm on Oct 3, 2012 (gmt 0)
newpost thread iconHow to stop google from indexing wordpress blog paginated archive
 
14Abhinav 6:57 am on Oct 3, 2012 (gmt 0)
newpost thread iconHow to block duplicate pages via robots.txt?
 
5hyderali 6:53 am on Oct 3, 2012 (gmt 0)
newpost thread iconHow do I block the homepage ONLY?
  Perhaps an unusual request
81script 6:22 am on Sep 28, 2012 (gmt 0)
newpost thread iconWho to create XML sitemap exclude URL parameter in Xenu's Link Sleuth
  Best practices to using Xenu's Link Sleuth
3rajesh_magar 10:46 am on Sep 25, 2012 (gmt 0)
newpost thread icondisable indexing only for part of the one page
  disabling part of the page to be indexed
1execom99 1:39 pm on Sep 19, 2012 (gmt 0)
newpost thread iconIncorrect Robots.txt URL in server Logs
 
5triggerfinger 7:57 pm on Sep 17, 2012 (gmt 0)
newpost thread iconRobots.txt Was Inaccessible
  Crawl Postponed Because Robots.txt Was Inaccessible
7poojabhatt 4:21 pm on Sep 16, 2012 (gmt 0)
newpost thread iconMoved: In page analytics moved
  Post was moved here: http://www.webmasterworld.com/analytics/4491502.htm
1System 11:25 am on Sep 4, 2012 (gmt 0)
newpost thread iconGoogle Index robots.txt
  google describes the result for the pages blcocked by robots.txt
9webseosolution 5:41 am on Aug 30, 2012 (gmt 0)
newpost thread iconGoogle appears to be ignoring 301'd URLs
  Googlebot indexing site by IP, even though server is set up to 301
13rowan194 6:50 pm on Aug 28, 2012 (gmt 0)
newpost thread iconBlocking sub-domain in robots.txt?
 
5shaunm 10:24 am on Aug 23, 2012 (gmt 0)
newpost thread iconApache: execute "global" php script when robots.txt requested
  Is there a way to make Apache run a script for a load of a particular file?
10rowan194 7:53 pm on Aug 20, 2012 (gmt 0)
newpost thread iconHow do I block a sub-domain?
  How do I block a dub-domain if the sub-domain is a virtual directory?
6shaunm 10:38 am on Aug 17, 2012 (gmt 0)
Displaying Page 2 of 70<< Back 1 [ 2 ] 3 4 5 6 7 8 9 10 11 ... 70 Next >>
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About
WebmasterWorld ® and PubCon ® are a Registered Trademarks of Pubcon Inc.
© Pubcon Inc. 1996-2012 all rights reserved