Welcome to WebmasterWorld Guest from 18.104.22.168
Using a robots.txt is all part of being a good SEO. Be sure to check yours in the robots.txt validator that is available to subscribers.
|Thread Subject||Messages||Started by||Last Message|
|How NOT to be seen.
What if you don't want search engines to find you?
|4||Hutch||10:05 pm May 2, 2009|
|Duplicate meta descriptions error?
Duplicate meta descriptions problem
|4||webturk||9:59 pm May 2, 2009|
|how popular websites are using sitemaps
||1||nealrodriguez||3:26 pm Apr 29, 2009|
|Generating an exhaustive xml sitemap
||3||DiscoStu||12:01 pm Apr 23, 2009|
|Google Sees Different Meta Descriptions On One Page
2 different meta descriptions appearing on search results for a same page
|5||awaisashraf||8:19 am Apr 23, 2009|
|Submitting A Sitemap To Protect Against Scrapers
Can scrapers take credit for your non-indexed pages?
|2||maximillianos||2:42 pm Apr 22, 2009|
|Best Pratice for Image URL with-in XML sitemaps?
Adding image URLs to XML sitemap
|3||dkaushikcrs||10:42 am Apr 22, 2009|
|Search engine friendly sitemap for 20,000+ page site and growing
|8||mayday88||9:54 pm Apr 20, 2009|
|Website not indexed at all
Everithing I can think of has been checked and site is still not indexed
|4||oscarhenao||11:26 am Apr 20, 2009|
||1||dailypress||1:28 am Apr 13, 2009|
|Using class in H1 tag
SEO agency says do not use class in H1 tag
|6||pankajj||3:29 pm Apr 12, 2009|
|Not Indexing a "Links" Page
||3||bobbonew||9:28 am Apr 7, 2009|
|Sitemap made according to Google's rules, still fails
Usage of subdomains scratches heads on Google's help page
|2||nycmoomin||1:59 pm Mar 31, 2009|
|Site is indexed but can't find pages with domain search
||5||crooky||3:17 pm Mar 30, 2009|
|Expert opinion on this robots.txt for wordpress blog
|2||denharsh||12:32 am Mar 30, 2009|
|xml sitemaps for large sites
||7||omoutop||12:31 am Mar 27, 2009|
|URLS with code
what the SERPs will index and not
|5||CLTaylor||11:44 pm Mar 22, 2009|
|Will this work?
|6||CWebguy||4:25 am Mar 19, 2009|
|Question Regarding Sitelink
||5||icreongame||8:52 am Mar 17, 2009|
|1 robots.txt file across multiple domains
Unable to implement individual robots.txt files - can I just use 1
|6||deadsetchamp||9:29 am Mar 16, 2009|
|Will Yahoo obey Wildcards in Robots?
||4||CWebguy||9:25 am Mar 16, 2009|
|Verification of WW5 and other non-www sites in Google Webmaster Tools
Is there a way to verify WW5.domain.com websites in Google Webmaster Files
|4||burnseo||9:11 am Mar 16, 2009|
|Putting "disallow: /" with listing subdirectories?
Would the first line would override the rest?
|2||pocket723||6:59 am Mar 16, 2009|
|What's with the robots.txt of this site?
||6||CWebguy||7:02 pm Mar 11, 2009|
|Txt. vs. XML Sitemap
Google says you can use both
|2||CWebguy||11:47 am Mar 11, 2009|