I have discovered that a competitor's cache is more than 6 month old. Before that they also had som ups and downs on the Google serp. IF you are doing somthing that Google don't like, is it then a common solution to stop bots spidering your web (and therby getting old cache)?
2:02 pm on Aug 8, 2006 (gmt 0)
If you are doing something which Google does not like then you are banned.
8:47 pm on Aug 8, 2006 (gmt 0)
Thanks for replay. I thought maybe our competitor kept their serp by disalow the bots and thereby keep high ranking (based on facts that their cache is nearly 8 month old)
9:13 pm on Aug 8, 2006 (gmt 0)
Only Google knows of course.
If they are banned they disappear (from Google) if they just dropped in the listings or are not visited often they lose rank or may be penalised in some way.
11:33 pm on Aug 8, 2006 (gmt 0)
Google has had some very old cache dates recently -- but if a site disallows googlebot, then sooner or later (and usually sooner) that domain will disappear completely from search results.
You don't need to guess, by the way -- assuming your competitior is example.com. Just type in www.example.com/robots.txt and read what they are using.
10:34 pm on Aug 11, 2006 (gmt 0)
Thanks for your help.
When I'm doing this www.example.com/robots.txt with my own site I get the info you describe. But when doing it with my competitor I unfortunately get their homepage. Is there anything else I can do?