homepage Welcome to WebmasterWorld Guest from 54.234.128.25
register, free tools, login, search, subscribe, help, library, announcements, recent posts, open posts,
Subscribe to WebmasterWorld
Visit PubCon.com
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt

Sitemaps, Meta Data, and robots.txt

Forum Charter, Library, Moderated by: goodroi Forum Options: Reset Last Read Pointers

Using a robots.txt is all part of being a good SEO. Be sure to check yours in the robots.txt validator that is available to subscribers.

 
new Subject Messages Started by Last Message
newpost thread iconSitemap Problem: Google shows sitemap URL in results instead of post U
 
2Lemans 10:44 pm on Jun 8, 2012 (gmt 0)
newpost thread iconRobots.txt and regular expressions
  Can they use them?
10jqwan 7:48 pm on Jun 4, 2012 (gmt 0)
newpost thread iconMozilla/4.* (Compatible
  to block or not?
13Seedy 9:25 pm on May 21, 2012 (gmt 0)
newpost thread iconMeta tag Rel="canonical" & double content
  How to use this?
15textex 1:59 am on May 20, 2012 (gmt 0)
newpost thread iconRobots.txt for canonical preference
  having dup content issues
5textex 9:23 am on May 19, 2012 (gmt 0)
newpost thread iconTitle and Description Meta Tags
 
4ultrafade 12:08 am on May 17, 2012 (gmt 0)
newpost thread icon180.x.x.x
 
3Seedy 7:47 am on May 15, 2012 (gmt 0)
newpost thread iconCrawl time
  crawlers
1satty 12:34 pm on Apr 28, 2012 (gmt 0)
newpost thread iconNo Follow on Redirected Pages
  Will 'no follow' on prevent transfer of SEO juice on redirected pages?
5ablu272 1:40 pm on Apr 16, 2012 (gmt 0)
newpost thread iconSitemap processing changed?
 
4HitProf 9:18 pm on Apr 4, 2012 (gmt 0)
newpost thread iconDisallow all URLs with ' '
 
25danwhitehouse 3:56 pm on Apr 4, 2012 (gmt 0)
newpost thread iconCan't seem to Disallow a Directory
  Disallow robots.txt robots
19Holygamer 10:52 pm on Mar 20, 2012 (gmt 0)
newpost thread iconMore than 60'000 404 error page
 
4mirkko22 9:09 am on Mar 14, 2012 (gmt 0)
newpost thread iconwhen robots get mad
 
1lucy24 7:54 pm on Mar 13, 2012 (gmt 0)
newpost thread iconGoogle Web Preview - images not displaying
 
3Seedy 12:15 pm on Mar 9, 2012 (gmt 0)
newpost thread icon.ca site ranking above .com site in USA
  Google is ranking the wrong (international) site for brand searches
4periscopeUP 1:36 pm on Mar 6, 2012 (gmt 0)
newpost thread iconDisallow vs noindex for duplicate content
  Disallow in robots.txt, or noindex in meta tag for duplicate content
6graeme_p 9:07 am on Mar 6, 2012 (gmt 0)
newpost thread iconlanguages and sitemaps
  where to put language specific urls in sitemaps
4Simon_Giddings 8:32 am on Feb 23, 2012 (gmt 0)
newpost thread iconexclude bookingform that is included on pages
 
11helenp 12:16 am on Feb 12, 2012 (gmt 0)
newpost thread iconMoved: Dropped from Google. moved
  Post was moved here: http://www.webmasterworld.com/google/4425676.htm
1System 10:04 am on Feb 3, 2012 (gmt 0)
newpost thread iconNeed Help! - no data in WMT - is it robots.txt or https?
  Something has happened to my search query data, I need help getting it back
3Scarlett1985 4:00 am on Feb 3, 2012 (gmt 0)
newpost thread iconGoogle keywords
  keywords, disallow, user, agent
8cyberdyne 12:01 pm on Jan 15, 2012 (gmt 0)
newpost thread iconHow do I stop g bot from crawling directories?
 
7shazam 5:38 pm on Jan 8, 2012 (gmt 0)
newpost thread iconPage Loads Fine but returning a 404 error
  Page Loads Fine but returning a 404 error
3ronleal0 1:01 pm on Jan 5, 2012 (gmt 0)
newpost thread iconRobots text to block all but index page of a forum
 
8Pjman 12:34 pm on Dec 22, 2011 (gmt 0)
Displaying Page 5 of 71<< Back 1 2 3 4 [ 5 ] 6 7 8 9 10 11 12 13 14 ... 71 Next >>
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved