Welcome to WebmasterWorld Guest from 18.104.22.168
Using a robots.txt is all part of being a good SEO. Be sure to check yours in the robots.txt validator that is available to subscribers.
|Thread Subject||Messages||Started by||Last Message|
|Regular Expressions, robots.txt, and robotstxt.org
||4||Funtick||7:24 pm Aug 14, 2008|
|How to disallow https urls
How to disallow https urls
|6||spiritualseo||8:39 pm Aug 12, 2008|
|URLs restricted by robots.txt
How to remove that restricton or reinclude URL
|2||Raheel||2:28 pm Aug 9, 2008|
|google search box
||1||sixeleven||3:10 pm Aug 8, 2008|
|Google has indexed my sitemap.xml
sitemap.xml appears as first result in serps for my domain
|2||wrightee||1:20 pm Aug 4, 2008|
|How to disallow subfolders
||3||bonagiri||10:03 am Jul 29, 2008|
|My website ranking dropped!
after i create a wrong robotx.txt...
|9||virtualreality||1:07 am Jul 29, 2008|
|Blocking parts of forum
but not others
|11||AnonyMouse||8:24 pm Jul 28, 2008|
|i should disallow ,second pages?
||3||sixeleven||2:37 pm Jul 25, 2008|
|How to disallow search results
How to disallow search results
|6||spiritualseo||2:01 pm Jul 17, 2008|
|Discrepancy between Webmaster Tools robots.txt analysis and reality
||6||fishfinger||10:05 am Jul 14, 2008|
|googlebot sitemap question
thinking about submitting sitemap, but not decided yet
|5||cirlong||2:38 pm Jul 13, 2008|
|Robots.txt code sensitive to missed spaces?
||6||Marketing_Guy||2:48 pm Jul 11, 2008|
|GoogleBot muxing URLS and I want to block it
||6||webdude||2:29 pm Jul 11, 2008|
|How to block this URLs
||3||vreelmistee||2:26 pm Jul 11, 2008|
|blocking certain files with robots.txt?
||5||htdawg||2:26 pm Jul 11, 2008|
||2||stormshield||5:13 pm Jul 6, 2008|
|Dynamic URL's and robots.txt
||4||cgydosh||3:37 pm Jul 2, 2008|
|How to setup robots.txt?
||3||Cameron08||10:23 am Jun 27, 2008|
|Indexing problem for few pages in Google
I have optimized one static web site vinsystech.com.
|3||venuakkala||12:49 pm Jun 24, 2008|
|Syntax for disallowing folder with '.' in the name?
Asking for clarification
|3||ALbino||10:40 pm Jun 23, 2008|
|Google ignores one line of robots.txt
||8||wheelie34||9:16 am Jun 22, 2008|
|Google under cover?
||3||Guido||1:38 pm Jun 13, 2008|
|Need to block and remove 1 page from serps
||4||StaceyJ||8:32 pm Jun 6, 2008|
||3||hugh||12:49 pm Jun 6, 2008|