Welcome to WebmasterWorld Guest from 220.127.116.11
Using a robots.txt is all part of being a good SEO. Be sure to check yours in the robots.txt validator that is available to subscribers.
|Thread Subject||Messages||Started by||Last Message|
|How to stop parameters page from being indexed
||3||thok||9:21 pm Mar 26, 2010|
|Stopping Voila from indexing
How to do it
|2||experienced||10:40 pm Mar 25, 2010|
|Moved: In Text Advertising
Post was moved here: http://www.webmasterworld.com/link_development/4105681.htm
|1||System||12:46 pm Mar 25, 2010|
|301 redirect sitemap not indexed -- resolved
||3||mycrystalbridge||1:42 pm Mar 24, 2010|
|Duplicate Domain Indexing Issue - Help Needed
||5||OldIrish||1:38 pm Mar 24, 2010|
|How to prevent a WAP site from appearing in Web Results ONLY?
Can you differentiate between Mobile Search & Web Search?
|2||shimsand||6:49 pm Mar 19, 2010|
|Google: bot crawls my site, but search not updated
Googlebot crawls my site every day, but site changes is not recorded
|4||kingoslo||12:28 pm Mar 18, 2010|
|Google Sitemap php
||2||Gemini23||12:22 pm Mar 18, 2010|
|The best way to add uncrawlable links?
|6||jonny0000||12:15 pm Mar 18, 2010|
|After using robots.txt none of the bots are crawling my site! Help
robots.txt is not working properly
|10||shamims||12:11 pm Mar 18, 2010|
|nofollow tag or prevent robots from visiting /admin page?
nofollow and robot.txt
|3||parliamenttutors||7:17 pm Mar 16, 2010|
|SEO Friendly Collapsable Content
There are several SEO friendly ways of displaying collapsable content. Wond
|7||jonny0000||3:23 pm Mar 16, 2010|
|Do these robot.txt's look ok?
||4||Boulder90||1:45 pm Mar 16, 2010|
|Persistent Crawl Errors
||2||GameTestLab||2:28 pm Mar 15, 2010|
|Google cached "disallow all" robots.txt and sitemap re-submit failed
||2||frankruijiang||1:55 pm Mar 5, 2010|
|Moved: question of a newbie - Checking Backlinks
Post was moved here: http://www.webmasterworld.com/link_development/4088876.htm
|1||System||5:45 pm Feb 27, 2010|
|Kilobytes downloaded per day vs Pages crawled per day
Kilobytes downloaded per day vs Pages crawled per day
|4||cocorocks||12:19 pm Feb 22, 2010|
|Robots.txt google webmasters blogger blogspot help
||2||Jcblue||12:17 pm Feb 22, 2010|
|Google site map issues when URL contains %3A
Google is not properly following site map URLs containing a %3A
|9||KenB||10:36 pm Feb 21, 2010|
|Constantly falling indexed pages and organic traffic in Google
Constantly falling indexed pages and organic traffic in Google
|2||cocorocks||4:34 pm Feb 16, 2010|
|Robots.txt and dynamic pages
||3||seasalt||8:03 am Feb 14, 2010|
|Do I need to resubmit a new sitemap for new content?
||8||BitShift||7:47 am Feb 14, 2010|
|SWF content and robots.txt
swf, robots.txt, google index, removal request, sandbox
|4||rob1m1982||8:11 pm Feb 12, 2010|
Should I block it?
|4||maximillianos||3:48 am Feb 10, 2010|
|Tool to check if multiple URLs are indexed?
||5||DiscoStu||9:25 am Feb 4, 2010|