Welcome to WebmasterWorld Guest from 18.104.22.168
Using a robots.txt is all part of being a good SEO. Be sure to check yours in the robots.txt validator that is available to subscribers.
|Thread Subject||Messages||Started by||Last Message|
|Where should I place robots.txt?
robots.txt location root directory or subdirectory with redirect 301
|5||cssatsc||7:46 pm May 26, 2009|
|robots.txt help needed
||2||aroon||4:03 pm May 26, 2009|
|How many search engines do I need to register with?
||6||Gertcher||7:15 am May 26, 2009|
|Joomla and sitemaps (rss and atom feeds for same url?)
||2||cmendla||11:10 am May 25, 2009|
|Disallow: /*?virtuemart=* not respected by google?
||7||SyntaxTerror||11:53 am May 24, 2009|
|New URL new Sitemap?
New URL new Sitemap?
|2||jestersdead||12:25 pm May 22, 2009|
Is this robots.txt compression valid?
|2||Webnauts||12:46 pm May 18, 2009|
|WP blog traffic plummeting. Bad robots.txt?
||13||Boulder90||5:14 am May 16, 2009|
|Sitemap VS Organic Traffic
||5||dailypress||2:36 pm May 14, 2009|
|Complex Sitemap Issue - Help Needed
How to set up sitemap with virrtual subdomains.
|1||1959mvp||4:16 am May 13, 2009|
|Sitemap for HTML + Wordpress pages?
One sitemap for both HTML and Wordpress pages?
|2||Denglish||4:24 am May 12, 2009|
|Google shows date before description tag in search results
|18||Mikey85||10:48 pm May 11, 2009|
|Google Webmaster Tool
Errors for URLs in Site
|4||fashezee||7:09 pm May 11, 2009|
|How to get just Homepage to be indexed, and not any other pages?
|7||dgc223||1:07 pm May 11, 2009|
|Problems With Cache Removal Page Removal
||5||flanok||12:24 pm May 5, 2009|
|time until a new robots rule gets acknowledged?
||3||httpwebwitch||8:33 am May 5, 2009|
|How NOT to be seen.
What if you don't want search engines to find you?
|4||Hutch||10:05 pm May 2, 2009|
|Duplicate meta descriptions error?
Duplicate meta descriptions problem
|4||webturk||9:59 pm May 2, 2009|
|how popular websites are using sitemaps
||1||nealrodriguez||3:26 pm Apr 29, 2009|
|Generating an exhaustive xml sitemap
||3||DiscoStu||12:01 pm Apr 23, 2009|
|Google Sees Different Meta Descriptions On One Page
2 different meta descriptions appearing on search results for a same page
|5||awaisashraf||8:19 am Apr 23, 2009|
|Submitting A Sitemap To Protect Against Scrapers
Can scrapers take credit for your non-indexed pages?
|2||maximillianos||2:42 pm Apr 22, 2009|
|Best Pratice for Image URL with-in XML sitemaps?
Adding image URLs to XML sitemap
|3||dkaushikcrs||10:42 am Apr 22, 2009|
|Search engine friendly sitemap for 20,000+ page site and growing
|8||mayday88||9:54 pm Apr 20, 2009|
|Website not indexed at all
Everithing I can think of has been checked and site is still not indexed
|4||oscarhenao||11:26 am Apr 20, 2009|