homepage Welcome to WebmasterWorld Guest from 107.22.78.233
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Visit PubCon.com
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt

Sitemaps, Meta Data, and robots.txt

Forum Charter, Library, Moderated by: goodroi Forum Options: Reset Last Read Pointers

Using a robots.txt is all part of being a good SEO. Be sure to check yours in the robots.txt validator that is available to subscribers.

 
new Subject Messages Started by Last Message
newpost thread iconHTTP 320 URLs, robots.txt and Google
  I need to remove indexed HTTP 302 Redirect URLs from Google index.
5nabucosound 12:38 am on Jun 16, 2012 (gmt 0)
newpost thread iconRobots Follow Meta Tag
  Will nofollow attribute override robots follow meta tag.
4Hoegaarden 1:20 am on Jun 9, 2012 (gmt 0)
newpost thread iconblock ? with robots.txt or htaccess
 
3zeus 10:52 pm on Jun 8, 2012 (gmt 0)
newpost thread iconSitemap Problem: Google shows sitemap URL in results instead of post U
 
2Lemans 10:44 pm on Jun 8, 2012 (gmt 0)
newpost thread iconRobots.txt and regular expressions
  Can they use them?
10jqwan 7:48 pm on Jun 4, 2012 (gmt 0)
newpost thread iconMozilla/4.* (Compatible
  to block or not?
13Seedy 9:25 pm on May 21, 2012 (gmt 0)
newpost thread iconMeta tag Rel="canonical" & double content
  How to use this?
15textex 1:59 am on May 20, 2012 (gmt 0)
newpost thread iconRobots.txt for canonical preference
  having dup content issues
5textex 9:23 am on May 19, 2012 (gmt 0)
newpost thread iconTitle and Description Meta Tags
 
4ultrafade 12:08 am on May 17, 2012 (gmt 0)
newpost thread icon180.x.x.x
 
3Seedy 7:47 am on May 15, 2012 (gmt 0)
newpost thread iconCrawl time
  crawlers
1satty 12:34 pm on Apr 28, 2012 (gmt 0)
newpost thread iconNo Follow on Redirected Pages
  Will 'no follow' on prevent transfer of SEO juice on redirected pages?
5ablu272 1:40 pm on Apr 16, 2012 (gmt 0)
newpost thread iconSitemap processing changed?
 
4HitProf 9:18 pm on Apr 4, 2012 (gmt 0)
newpost thread iconDisallow all URLs with ' '
 
25danwhitehouse 3:56 pm on Apr 4, 2012 (gmt 0)
newpost thread iconCan't seem to Disallow a Directory
  Disallow robots.txt robots
19Holygamer 10:52 pm on Mar 20, 2012 (gmt 0)
newpost thread iconMore than 60'000 404 error page
 
4mirkko22 9:09 am on Mar 14, 2012 (gmt 0)
newpost thread iconwhen robots get mad
 
1lucy24 7:54 pm on Mar 13, 2012 (gmt 0)
newpost thread iconGoogle Web Preview - images not displaying
 
3Seedy 12:15 pm on Mar 9, 2012 (gmt 0)
newpost thread icon.ca site ranking above .com site in USA
  Google is ranking the wrong (international) site for brand searches
4periscopeUP 1:36 pm on Mar 6, 2012 (gmt 0)
newpost thread iconDisallow vs noindex for duplicate content
  Disallow in robots.txt, or noindex in meta tag for duplicate content
6graeme_p 9:07 am on Mar 6, 2012 (gmt 0)
newpost thread iconlanguages and sitemaps
  where to put language specific urls in sitemaps
4Simon_Giddings 8:32 am on Feb 23, 2012 (gmt 0)
newpost thread iconexclude bookingform that is included on pages
 
11helenp 12:16 am on Feb 12, 2012 (gmt 0)
newpost thread iconMoved: Dropped from Google. moved
  Post was moved here: http://www.webmasterworld.com/google/4425676.htm
1System 10:04 am on Feb 3, 2012 (gmt 0)
newpost thread iconNeed Help! - no data in WMT - is it robots.txt or https?
  Something has happened to my search query data, I need help getting it back
3Scarlett1985 4:00 am on Feb 3, 2012 (gmt 0)
newpost thread iconGoogle keywords
  keywords, disallow, user, agent
8cyberdyne 12:01 pm on Jan 15, 2012 (gmt 0)
Displaying Page 5 of 71<< Back 1 2 3 4 [ 5 ] 6 7 8 9 10 11 12 13 14 ... 71 Next >>
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved