Welcome to WebmasterWorld Guest from 184.108.40.206
Using a robots.txt is all part of being a good SEO. Be sure to check yours in the robots.txt validator that is available to subscribers.
|Thread Subject||Messages||Started by||Last Message|
|Geting lots of hits on robots.txt but not much indexes in Yahoo/Google
||8||ball4121||4:47 am Nov 26, 2005|
|simple robots.txt question
just to make sure
|5||followgreg||4:24 am Nov 26, 2005|
|Robots.txt Vs META name="robots"
Which is better?
|4||Fuzzi_Bear||8:46 pm Nov 25, 2005|
|Quick robots.txt help
is this the right syntax?
|3||Fuzzi_Bear||2:17 pm Nov 25, 2005|
|ban all robots for a short period
||11||digicam||6:02 pm Nov 23, 2005|
||5||phpmaven||4:45 pm Nov 23, 2005|
Mobile content might be seen as Duplicate.
|1||designasp||12:41 am Nov 23, 2005|
|Gap - how many days
||4||successlieswithme||9:39 am Nov 22, 2005|
|why has google not removed these url's
||3||fzx5v0||3:48 am Nov 21, 2005|
|Capitalize robots.txt filename?
Robots.txt or robots.txt
|3||4string||4:18 am Nov 17, 2005|
|Need help removing multiple pages
||3||tintin74||11:00 am Nov 15, 2005|
|Help with Disallow
Not sure if I got this right...
|3||BillyS||8:52 pm Nov 14, 2005|
|stop Yahoo's crawler but for specific domains
how to stop yahoo's crawler for specif domains
|2||nrueda||11:40 pm Nov 8, 2005|
|wildcard for googlebot
||4||fzx5v0||4:02 pm Nov 7, 2005|
|Proposing updates to the robots.txt standard
It is time for a change
|16||volatilegx||9:20 pm Nov 4, 2005|
|what i did wrong?
||5||fluxer||3:45 pm Nov 4, 2005|
|protected ffiles and robots
||2||StickeR||7:48 pm Nov 3, 2005|
|Exculde php url with vars using robots.txt
Exclude urls with vars using robots.txt
|2||alexmart||7:44 pm Nov 3, 2005|
|Is Temporary Disallow a Problem Later?
||6||bumpaw||2:10 pm Nov 3, 2005|
||7||Autoweb||8:25 am Nov 3, 2005|
|Added robots.txt - 3 days later rankings gone!
||11||Block19Row13||3:45 pm Nov 2, 2005|
|OK now I am baffled - question from new to SEO
||4||Iwrite||12:38 pm Nov 2, 2005|
|Robots.text question, disallowing files
||10||mikeD||1:37 am Nov 2, 2005|
|crawl delay in google, msn, yahoo etc.
|4||freegk||7:03 pm Nov 1, 2005|
|Is robots.txt That necessary?
||5||makzan||7:02 pm Nov 1, 2005|