homepage Welcome to WebmasterWorld Guest from 54.211.230.186
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Pubcon Platinum Sponsor 2014
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt

Sitemaps, Meta Data, and robots.txt

Forum Charter, Library, Moderated by: goodroi Forum Options: Reset Last Read Pointers

Using a robots.txt is all part of being a good SEO. Be sure to check yours in the robots.txt validator that is available to subscribers.

 
new Subject Messages Started by Last Message
newpost thread iconGoogle appears to be ignoring 301'd URLs
  Googlebot indexing site by IP, even though server is set up to 301
13rowan194 6:50 pm on Aug 28, 2012 (gmt 0)
newpost thread iconBlocking sub-domain in robots.txt?
 
5shaunm 10:24 am on Aug 23, 2012 (gmt 0)
newpost thread iconApache: execute "global" php script when robots.txt requested
  Is there a way to make Apache run a script for a load of a particular file?
10rowan194 7:53 pm on Aug 20, 2012 (gmt 0)
newpost thread iconHow do I block a sub-domain?
  How do I block a dub-domain if the sub-domain is a virtual directory?
6shaunm 10:38 am on Aug 17, 2012 (gmt 0)
newpost thread iconDifferent search result for searching single and plural word
 
2bubble 2:43 pm on Aug 13, 2012 (gmt 0)
newpost thread iconGooglebot possibly ignoring robots.txt
 
23Andem 6:27 am on Jul 29, 2012 (gmt 0)
newpost thread iconNoindex vs Disallow within a Sitemap
  What is the use of using Noindex within a Sitemap?
9shaunm 5:28 am on Jul 27, 2012 (gmt 0)
newpost thread icongoogle duplicate title issue
 
7jon22 10:02 am on Jul 6, 2012 (gmt 0)
newpost thread iconccTLDs and Sitemaps
  Can I have one XML sitemap for all my ccTLDs?
3shaunm 9:35 am on Jun 25, 2012 (gmt 0)
newpost thread iconHTTP 320 URLs, robots.txt and Google
  I need to remove indexed HTTP 302 Redirect URLs from Google index.
5nabucosound 12:38 am on Jun 16, 2012 (gmt 0)
newpost thread iconRobots Follow Meta Tag
  Will nofollow attribute override robots follow meta tag.
4Hoegaarden 1:20 am on Jun 9, 2012 (gmt 0)
newpost thread iconblock ? with robots.txt or htaccess
 
3zeus 10:52 pm on Jun 8, 2012 (gmt 0)
newpost thread iconSitemap Problem: Google shows sitemap URL in results instead of post U
 
2Lemans 10:44 pm on Jun 8, 2012 (gmt 0)
newpost thread iconRobots.txt and regular expressions
  Can they use them?
10jqwan 7:48 pm on Jun 4, 2012 (gmt 0)
newpost thread iconMozilla/4.* (Compatible
  to block or not?
13Seedy 9:25 pm on May 21, 2012 (gmt 0)
newpost thread iconMeta tag Rel="canonical" & double content
  How to use this?
15textex 1:59 am on May 20, 2012 (gmt 0)
newpost thread iconRobots.txt for canonical preference
  having dup content issues
5textex 9:23 am on May 19, 2012 (gmt 0)
newpost thread iconTitle and Description Meta Tags
 
4ultrafade 12:08 am on May 17, 2012 (gmt 0)
newpost thread icon180.x.x.x
 
3Seedy 7:47 am on May 15, 2012 (gmt 0)
newpost thread iconCrawl time
  crawlers
1satty 12:34 pm on Apr 28, 2012 (gmt 0)
newpost thread iconNo Follow on Redirected Pages
  Will 'no follow' on prevent transfer of SEO juice on redirected pages?
5ablu272 1:40 pm on Apr 16, 2012 (gmt 0)
newpost thread iconSitemap processing changed?
 
4HitProf 9:18 pm on Apr 4, 2012 (gmt 0)
newpost thread iconDisallow all URLs with ' '
 
25danwhitehouse 3:56 pm on Apr 4, 2012 (gmt 0)
newpost thread iconCan't seem to Disallow a Directory
  Disallow robots.txt robots
19Holygamer 10:52 pm on Mar 20, 2012 (gmt 0)
newpost thread iconMore than 60'000 404 error page
 
4mirkko22 9:09 am on Mar 14, 2012 (gmt 0)
Displaying Page 5 of 72<< Back 1 2 3 4 [ 5 ] 6 7 8 9 10 11 12 13 14 ... 72 Next >>
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved