homepage Welcome to WebmasterWorld Guest from 54.204.179.32
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Pubcon Platinum Sponsor 2014
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt

Sitemaps, Meta Data, and robots.txt

Forum Charter, Library, Moderated by: goodroi Forum Options: Reset Last Read Pointers

Using a robots.txt is all part of being a good SEO. Be sure to check yours in the robots.txt validator that is available to subscribers.

 
new Subject Messages Started by Last Message
newpost thread iconPutting "disallow: /" with listing subdirectories?
  Would the first line would override the rest?
2pocket723 6:59 am on Mar 16, 2009 (gmt 0)
newpost thread iconWhat's with the robots.txt of this site?
 
6CWebguy 7:02 pm on Mar 11, 2009 (gmt 0)
newpost thread iconTxt. vs. XML Sitemap
  Google says you can use both
2CWebguy 11:47 am on Mar 11, 2009 (gmt 0)
newpost thread iconRemoval of URLs from google using Webmaster Tools
 
3jackgordon 4:29 am on Mar 10, 2009 (gmt 0)
newpost thread iconnoindex meta positioning
 
4jackgordon 11:03 pm on Mar 9, 2009 (gmt 0)
newpost thread iconWhy Google is following my links?
 
2himalayaswater 1:37 pm on Mar 3, 2009 (gmt 0)
newpost thread iconHow Important is a Site Map
 
3Possum11 4:05 pm on Mar 2, 2009 (gmt 0)
newpost thread iconMeta Data within dreamweaver template
  Meta Data within dreamweaver template
2jackgordon 3:49 pm on Mar 2, 2009 (gmt 0)
newpost thread iconWebsite Disallowed through robots.txt, will google re index
  Website Disallowed through robots.txt, will google re index
3jackgordon 9:41 am on Feb 28, 2009 (gmt 0)
newpost thread iconTrying to find a sitemap generator for vista home Prem / .net 3.5 sp1
 
3cmendla 1:41 am on Feb 28, 2009 (gmt 0)
newpost thread iconWill Google Index Page not in Sitemap?
 
3CWebguy 6:25 pm on Feb 27, 2009 (gmt 0)
newpost thread iconSitemaps Generator on Large Site
  Could this cause problems?
5CWebguy 6:23 pm on Feb 27, 2009 (gmt 0)
newpost thread iconvspider not adhereing to robots.txt
 
6tonynoriega 11:07 pm on Feb 26, 2009 (gmt 0)
newpost thread iconblock dynamic urls with product options using robots.txt?
  How do I?
2circusboy 3:53 pm on Feb 24, 2009 (gmt 0)
newpost thread iconwhy use a robots.txt
 
17tonynoriega 3:49 pm on Feb 23, 2009 (gmt 0)
newpost thread iconCan't succeed in blocking directories in robots txt
  The paths are already in robots txt but google still crawles those pages.
6stephang 6:27 am on Feb 18, 2009 (gmt 0)
newpost thread iconDisallowing Any Link with a Question Mark in it?
  What is the correct way to do this. Is this the best approach?
11bouncybunny 9:28 am on Feb 16, 2009 (gmt 0)
newpost thread iconPermanent 301 redirect to new domain name
  Permanent 301 redirect to new domain name
16Farhan 1:13 am on Feb 16, 2009 (gmt 0)
newpost thread iconrobots and link page
 
1bode 4:46 pm on Feb 15, 2009 (gmt 0)
newpost thread iconXML Sitemap for Blog
  How to create it?
2vicky 11:57 pm on Feb 12, 2009 (gmt 0)
newpost thread iconGSite Crawler
  Soft Plus GsiteCrawler compile the correct format for xml
2Gemini23 12:16 pm on Feb 9, 2009 (gmt 0)
newpost thread iconCorrect way to exclude all dynamic pages under one url?
 
3jackgordon 8:55 pm on Feb 7, 2009 (gmt 0)
newpost thread iconDuplicate content and NO INDEX
  duplicate web content
3Dezblanco 4:05 pm on Feb 6, 2009 (gmt 0)
newpost thread iconDid I invent these meta tags or are they official?
  Odd that many sites now use these tags...
2Ducki 10:45 am on Feb 6, 2009 (gmt 0)
newpost thread iconWordpress sitemap widget
  wordpress, widgets,seo
5Manfred 1:49 pm on Feb 4, 2009 (gmt 0)
Displaying Page 20 of 72<< Back 1 ... 10 11 12 13 14 15 16 17 18 19 [ 20 ] 21 22 23 24 25 26 27 28 29 ... 72 Next >>
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved