Welcome to WebmasterWorld Guest from 22.214.171.124
Using a robots.txt is all part of being a good SEO. Be sure to check yours in the robots.txt validator that is available to subscribers.
|Thread Subject||Messages||Started by||Last Message|
|Verify site ownership failed - Bing
||5||Vrindavan||11:24 am Sep 1, 2010|
||3||rros||4:55 am Aug 28, 2010|
|Robots.txt - Block all but Most Popular?
||4||mmiller||3:16 am Aug 28, 2010|
||5||rros||6:24 pm Aug 26, 2010|
|Want to Deny Google from Indexing, Crawling My Private Site
Google keeps pestering, is my robots text wrong?
|8||erlandc||12:59 pm Aug 26, 2010|
|Robots.txt - Disallow subdomain only
||3||pavlovapete||7:30 am Aug 26, 2010|
|Pages & Google XML Sitemap Worpress Pluggin
||3||arkain||12:26 am Aug 17, 2010|
|Pattern Matching in Robots.txt !
Can someone please clarify a few points for me?
|3||james22||6:22 am Aug 16, 2010|
|Submitting child sitemaps too alongwith sitemap index file ?
sitemap issue for mammoth sites
|4||OMZen||2:45 am Aug 14, 2010|
|Controlling Crawler Access - different options
||4||Super_Chunk||9:20 am Aug 9, 2010|
|GWT, Robots.txt Update Timing
How long might it typically take for Google Webmaster Tools to update?
|9||edgeportals||7:35 pm Aug 4, 2010|
|How do you make search engines index ALL the urls in a sitemap file?
How do you make search engines index ALL the urls in a sitemap file?
|8||Vrindavan||12:45 pm Jul 23, 2010|
|What search engines allow you to submit a sitemap file .xml to them ?
||2||Vrindavan||3:29 am Jul 23, 2010|
|Will New XML Sitemap Format By Google Will Be Adopted By Yahoo & Bing
||4||webexpert2u||7:34 am Jul 22, 2010|
|Managing XML sitemap by hand.
Is bare bones-format suitable?
|4||Broadway||7:24 am Jul 22, 2010|
|Do I Need 2 Sitemaps?
||2||ElvisFan||12:38 pm Jul 17, 2010|
|Placing Sitemaps in Robots.txt
Do I put all 3?
|4||jdancing||7:20 pm Jul 12, 2010|
|Wordpress Sitemap with lots of noindex nofollow
||3||jdancing||7:15 pm Jul 12, 2010|
|Just how important are meta keywords?
||17||Tom_Cash||3:52 am Jul 8, 2010|
|robots.txt and wildcards
|7||chms||2:08 pm Jul 7, 2010|
|One sitemap can cover multiple sites - kinda cool.
||4||Sgt_Kickaxe||11:54 am Jul 6, 2010|
|Google does not accept my sitemap
|6||windermann||10:35 am Jul 3, 2010|
|remove outdated data from Google cache
||7||thosecars82||11:46 am Jun 25, 2010|
|How to validate an xml sitemap
||5||amythepoet||11:22 am Jun 23, 2010|
|robots.txt / keywords
||5||cyberdyne||11:57 pm Jun 16, 2010|