homepage Welcome to WebmasterWorld Guest from 54.226.0.225
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt

Sitemaps, Meta Data, and robots.txt

Forum Charter, Library, Moderated by: goodroi Forum Options: Reset Last Read Pointers

Using a robots.txt is all part of being a good SEO. Be sure to check yours in the robots.txt validator that is available to subscribers.

 
new Subject Messages Started by Last Message
newpost thread iconexclude bookingform that is included on pages
 
11helenp 12:16 am on Feb 12, 2012 (gmt 0)
newpost thread iconMoved: Dropped from Google. moved
  Post was moved here: http://www.webmasterworld.com/google/4425676.htm
1System 10:04 am on Feb 3, 2012 (gmt 0)
newpost thread iconNeed Help! - no data in WMT - is it robots.txt or https?
  Something has happened to my search query data, I need help getting it back
3Scarlett1985 4:00 am on Feb 3, 2012 (gmt 0)
newpost thread iconGoogle keywords
  keywords, disallow, user, agent
8cyberdyne 12:01 pm on Jan 15, 2012 (gmt 0)
newpost thread iconHow do I stop g bot from crawling directories?
 
7shazam 5:38 pm on Jan 8, 2012 (gmt 0)
newpost thread iconPage Loads Fine but returning a 404 error
  Page Loads Fine but returning a 404 error
3ronleal0 1:01 pm on Jan 5, 2012 (gmt 0)
newpost thread iconRobots text to block all but index page of a forum
 
8Pjman 12:34 pm on Dec 22, 2011 (gmt 0)
newpost thread iconMicroformats for when the page has no rating?
 
2azn_romeo_4u 12:02 am on Dec 21, 2011 (gmt 0)
newpost thread iconHTML suggestions - Duplicate title tags report
 
14Vrindavan 12:20 am on Dec 20, 2011 (gmt 0)
newpost thread iconMobile or regular sitemap?
  best practice for smartphone oriented sites
1Mishaelo 6:59 am on Dec 14, 2011 (gmt 0)
newpost thread icongoogle changing link structure and then serving 404 in WMT
 
1meelosh 10:07 pm on Nov 23, 2011 (gmt 0)
newpost thread iconLink checker reports some exclusion
 
2toplisek 11:29 pm on Nov 9, 2011 (gmt 0)
newpost thread iconIssues with Bing Sitemap files
  Bing webmaster is showing errors for files accepted in Google webmaster
7pankajj 1:46 pm on Nov 5, 2011 (gmt 0)
newpost thread iconDuplicate Content
 
4joyjesters 11:12 pm on Nov 1, 2011 (gmt 0)
newpost thread iconMobile video sitemaps
  Whats are the changes from desktop video sitemap?
6Mishaelo 6:29 am on Oct 27, 2011 (gmt 0)
newpost thread iconVideo sitemaps and CDNs
  Having index and sitemap files on different domains
7Mishaelo 9:50 am on Oct 19, 2011 (gmt 0)
newpost thread iconSitemap for N number of pages
 
3srisudha 6:10 am on Oct 18, 2011 (gmt 0)
newpost thread iconAllow: ?
 
4mihomes 12:57 am on Oct 1, 2011 (gmt 0)
newpost thread iconGoogle sitemap errors
  URLs redirect to other locations
2night707 3:20 am on Sep 27, 2011 (gmt 0)
newpost thread iconCorrect use of meta data keywords
  Correct use of meta data keywords
7xshadow 7:02 am on Sep 11, 2011 (gmt 0)
newpost thread iconGoogle indexing blocked content
 
6fatpeter 5:52 pm on Sep 10, 2011 (gmt 0)
newpost thread iconCategory and Tag pages in Sitemap
  listing noindex pages in sitemap
2cloud36 6:54 am on Sep 9, 2011 (gmt 0)
newpost thread iconRobots.txt for Wordpress and Vbulletin together - Help
  Robots.txt for Wordpress and Vbulletin - Help
7anticipation 11:17 pm on Sep 3, 2011 (gmt 0)
newpost thread iconGoogle's Search Result Display Pattern
 
5webexpert2u 3:42 am on Aug 31, 2011 (gmt 0)
newpost thread iconrobots.txt disallow searching reoccuring folders
 
6jchristi 2:14 am on Aug 30, 2011 (gmt 0)
Displaying Page 6 of 72<< Back 1 2 3 4 5 [ 6 ] 7 8 9 10 11 12 13 14 15 ... 72 Next >>
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved