homepage Welcome to WebmasterWorld Guest from 54.166.95.146
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt

Sitemaps, Meta Data, and robots.txt

Forum Charter, Library, Moderated by: goodroi Forum Options: Reset Last Read Pointers

Using a robots.txt is all part of being a good SEO. Be sure to check yours in the robots.txt validator that is available to subscribers.

 
new Subject Messages Started by Last Message
newpost thread iconNeed Help! - no data in WMT - is it robots.txt or https?
  Something has happened to my search query data, I need help getting it back
3Scarlett1985 4:00 am on Feb 3, 2012 (gmt 0)
newpost thread iconGoogle keywords
  keywords, disallow, user, agent
8cyberdyne 12:01 pm on Jan 15, 2012 (gmt 0)
newpost thread iconHow do I stop g bot from crawling directories?
 
7shazam 5:38 pm on Jan 8, 2012 (gmt 0)
newpost thread iconPage Loads Fine but returning a 404 error
  Page Loads Fine but returning a 404 error
3ronleal0 1:01 pm on Jan 5, 2012 (gmt 0)
newpost thread iconRobots text to block all but index page of a forum
 
8Pjman 12:34 pm on Dec 22, 2011 (gmt 0)
newpost thread iconMicroformats for when the page has no rating?
 
2azn_romeo_4u 12:02 am on Dec 21, 2011 (gmt 0)
newpost thread iconHTML suggestions - Duplicate title tags report
 
14Vrindavan 12:20 am on Dec 20, 2011 (gmt 0)
newpost thread iconMobile or regular sitemap?
  best practice for smartphone oriented sites
1Mishaelo 6:59 am on Dec 14, 2011 (gmt 0)
newpost thread icongoogle changing link structure and then serving 404 in WMT
 
1meelosh 10:07 pm on Nov 23, 2011 (gmt 0)
newpost thread iconLink checker reports some exclusion
 
2toplisek 11:29 pm on Nov 9, 2011 (gmt 0)
newpost thread iconIssues with Bing Sitemap files
  Bing webmaster is showing errors for files accepted in Google webmaster
7pankajj 1:46 pm on Nov 5, 2011 (gmt 0)
newpost thread iconDuplicate Content
 
4joyjesters 11:12 pm on Nov 1, 2011 (gmt 0)
newpost thread iconMobile video sitemaps
  Whats are the changes from desktop video sitemap?
6Mishaelo 6:29 am on Oct 27, 2011 (gmt 0)
newpost thread iconVideo sitemaps and CDNs
  Having index and sitemap files on different domains
7Mishaelo 9:50 am on Oct 19, 2011 (gmt 0)
newpost thread iconSitemap for N number of pages
 
3srisudha 6:10 am on Oct 18, 2011 (gmt 0)
newpost thread iconAllow: ?
 
4mihomes 12:57 am on Oct 1, 2011 (gmt 0)
newpost thread iconGoogle sitemap errors
  URLs redirect to other locations
2night707 3:20 am on Sep 27, 2011 (gmt 0)
newpost thread iconCorrect use of meta data keywords
  Correct use of meta data keywords
7xshadow 7:02 am on Sep 11, 2011 (gmt 0)
newpost thread iconGoogle indexing blocked content
 
6fatpeter 5:52 pm on Sep 10, 2011 (gmt 0)
newpost thread iconCategory and Tag pages in Sitemap
  listing noindex pages in sitemap
2cloud36 6:54 am on Sep 9, 2011 (gmt 0)
newpost thread iconRobots.txt for Wordpress and Vbulletin together - Help
  Robots.txt for Wordpress and Vbulletin - Help
7anticipation 11:17 pm on Sep 3, 2011 (gmt 0)
newpost thread iconGoogle's Search Result Display Pattern
 
5webexpert2u 3:42 am on Aug 31, 2011 (gmt 0)
newpost thread iconrobots.txt disallow searching reoccuring folders
 
6jchristi 2:14 am on Aug 30, 2011 (gmt 0)
newpost thread iconhow to disallow feed in robot.txt readable by all bots
 
5bhavana 4:42 am on Aug 17, 2011 (gmt 0)
newpost thread iconSitemap for out of stock products
 
2sam222 6:43 am on Aug 9, 2011 (gmt 0)
Displaying Page 6 of 71<< Back 1 2 3 4 5 [ 6 ] 7 8 9 10 11 12 13 14 15 ... 71 Next >>
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved