homepage Welcome to WebmasterWorld Guest from 50.16.49.108
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt

Sitemaps, Meta Data, and robots.txt

Forum Charter, Library, Moderated by: goodroi Forum Options: Reset Last Read Pointers

Using a robots.txt is all part of being a good SEO. Be sure to check yours in the robots.txt validator that is available to subscribers.

 
new Subject Messages Started by Last Message
newpost thread iconwhat is the User-Agent?
 
3lucy24 12:58 pm on Mar 24, 2013 (gmt 0)
newpost thread iconA huge number of URL's monitored on GWT
  Need to remove all of them
5morpheus83 4:41 am on Mar 20, 2013 (gmt 0)
newpost thread icontrafficbasedwtf
 
1lucy24 11:41 pm on Mar 4, 2013 (gmt 0)
newpost thread icongooglebot not get robots.txt
  robots.txt
5Luka2013 1:06 am on Mar 2, 2013 (gmt 0)
newpost thread iconWhy we use sitem.xml?
 
7levijoseph 10:35 am on Mar 1, 2013 (gmt 0)
newpost thread iconold Domain re-directed to New, Sitemap still getting read by old profi
 
2sikkiagarwal 10:22 am on Feb 8, 2013 (gmt 0)
newpost thread iconMultiple Websites block through Robots?
 
6Mansi_Padhya 7:14 pm on Jan 31, 2013 (gmt 0)
newpost thread iconGoogle Sucking My Images Up
  Why Why Why?
7delboy1978uk 10:50 pm on Jan 27, 2013 (gmt 0)
newpost thread iconCan I have multiple sitemap.xml's for Google?
  multiple sitemaps xml html
52kegx 10:32 am on Jan 21, 2013 (gmt 0)
newpost thread iconrobots.txt need help
 
4a4tech 10:20 pm on Jan 15, 2013 (gmt 0)
newpost thread iconDifferent sitemaps for different categories?
  Is it a good idea to use different sitemaps for different categories?
6Matticca 8:28 pm on Jan 6, 2013 (gmt 0)
newpost thread icon301 redirect
 
4ultrafade 11:02 am on Dec 17, 2012 (gmt 0)
newpost thread iconMeta Tags for PDF files
  how to set meta tags for pdf files?
6webseosolution 11:00 pm on Dec 12, 2012 (gmt 0)
newpost thread iconHow can I block strange URL's?
 
8IndigoHollow 5:30 pm on Nov 22, 2012 (gmt 0)
newpost thread iconReindexing problem with google
 
2algeriano 7:25 pm on Nov 16, 2012 (gmt 0)
newpost thread iconCrawl Errors - How to manage them effectively?
 
10shaunm 10:11 am on Nov 16, 2012 (gmt 0)
newpost thread iconRobot.txt
  what is the use of Robot.txt
4divyarenjudlk 7:35 pm on Nov 7, 2012 (gmt 0)
newpost thread iconDoes Meta Description affect Rankings in 2012 ha Ok 2013?
 
3nikhilrajr 9:03 am on Nov 7, 2012 (gmt 0)
newpost thread iconOrchestr8
  66.35.60.158
1Bewenched 4:03 am on Nov 5, 2012 (gmt 0)
newpost thread iconProduct microformat without reviews
  Still works?
1SabrinaScherer 2:54 pm on Oct 11, 2012 (gmt 0)
newpost thread iconNew Thought to an Old Thread
  Before you reply, read the entire post including the thread link
2Propools 1:34 am on Oct 11, 2012 (gmt 0)
newpost thread iconSite Map Verses Robot Text File
  Nouf Taraman, Text,
2nouftaraman 2:18 am on Oct 9, 2012 (gmt 0)
newpost thread iconMoved: BPImage walker moved
  Post was moved here: http://www.webmasterworld.com/search_engine_spiders/4503671.htm
1System 8:29 pm on Oct 3, 2012 (gmt 0)
newpost thread iconHow to stop google from indexing wordpress blog paginated archive
 
14Abhinav 6:57 am on Oct 3, 2012 (gmt 0)
newpost thread iconHow to block duplicate pages via robots.txt?
 
5hyderali 6:53 am on Oct 3, 2012 (gmt 0)
Displaying Page 4 of 72<< Back 1 2 3 [ 4 ] 5 6 7 8 9 10 11 12 13 ... 72 Next >>
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved