Welcome to WebmasterWorld Guest from 184.108.40.206
Using a robots.txt is all part of being a good SEO. Be sure to check yours in the robots.txt validator that is available to subscribers.
|Thread Subject||Messages||Started by||Last Message|
|Matching URL with encoded ampersand against robots.txt
||3||aakk9999||12:45 am Nov 18, 2009|
||2||stevelibby||12:32 am Nov 18, 2009|
|Adding Feeds To Webmaster tools
Adding RSS feed url in google webmaster tool
|3||VirginTech||1:37 pm Nov 16, 2009|
|Google Sitemap Generator installs - but I can't configure it!
||1||webpro00801||4:56 pm Nov 9, 2009|
|My last two new pages from blog not indexed (first time for years)
||3||tomda||6:23 am Nov 9, 2009|
|Stop Subdomain Indexing
My Development Subdomain Being Indexed
|2||vetofunk||11:01 pm Nov 8, 2009|
|http:/ / translate. googleusercontent. com/ translate c
||1||nomis5||11:10 am Nov 7, 2009|
|Sitemap "Priority" and bot behavior
Will the priority attribute affect how spiders crawl?
|3||arieng||6:07 pm Nov 6, 2009|
|SiteMap and Robots.txt Indexing
What is the right way to avoid it?
|5||kitamed||3:49 pm Nov 6, 2009|
|Google Sitemap Indexed URLs going down
||4||themoron1||1:12 pm Nov 6, 2009|
|Problems crawling my pages for XML Sitemap
Spider simulators (all of them) seem to struggle
|1||Munster||12:15 pm Nov 5, 2009|
|How to stop search engines caching my webpages?
||11||gcan||4:31 am Nov 2, 2009|
redirect in htaccess file
|3||anyone||3:53 pm Oct 29, 2009|
|Will URLs blocked in robots.txt remove currently indexed pages?
||6||limitup||12:20 am Oct 28, 2009|
|Noindex and also Changeing 2 million URL's
||2||azn_romeo_4u||10:53 am Oct 27, 2009|
|Blocked Shot - Robots.txt
blocking numerous duplicate pages using robots.txt
|6||underglass||10:50 am Oct 27, 2009|
|Need a Sitemap Generator
||2||eljuan||8:52 pm Oct 26, 2009|
|site map generator program
site map generator
|7||Roobik||12:27 pm Oct 26, 2009|
|Webmaster Tools Issues - Need Help
Webmaster tools showing data that does not reflect in Google
|3||ranadeep||7:16 am Oct 22, 2009|
|meta name="allow search" content="yes"
do i really need this tag now?
|4||supafresh||1:52 am Oct 20, 2009|
|Question concerning Disallow and *
||4||augustwind||1:44 am Oct 20, 2009|
|Which Is The Better Way To Handle Site Title
Which is the better way to handle the site title.
|4||Robert||11:40 pm Oct 18, 2009|
|Webmaster URL Removal Issues
Robots file/URL removal issues
|10||MarkWW||3:24 pm Oct 13, 2009|
|Different content on the same URL
Users language is stored in a cookie - website displays different content o
|3||gcan||9:23 pm Oct 12, 2009|
|Why search engines are showing the wrong meta title & description
Metadata was correct two months ago but now search engine showing wrong.
|4||Kash||2:36 pm Oct 12, 2009|