Welcome to WebmasterWorld Guest from

Forum Moderators: brotherhood of lan & mack

Message Too Old, No Replies

Newbee question about Google cache/bot/serp



11:25 pm on Jul 31, 2006 (gmt 0)

5+ Year Member

I have discovered that a competitor's cache is more than 6 month old.
Before that they also had som ups and downs on the Google serp.
IF you are doing somthing that Google don't like, is it then a common solution to stop bots spidering your web (and therby getting old cache)?


2:02 pm on Aug 8, 2006 (gmt 0)

5+ Year Member

If you are doing something which Google does not like then you are banned.


8:47 pm on Aug 8, 2006 (gmt 0)

5+ Year Member

Thanks for replay.
I thought maybe our competitor kept their serp by disalow the bots and thereby keep high ranking (based on facts that their cache is nearly 8 month old)


9:13 pm on Aug 8, 2006 (gmt 0)

10+ Year Member

Only Google knows of course.

If they are banned they disappear (from Google) if they just dropped in the listings or are not visited often they lose rank or may be penalised in some way.


11:33 pm on Aug 8, 2006 (gmt 0)

WebmasterWorld Senior Member tedster is a WebmasterWorld Top Contributor of All Time 10+ Year Member

Google has had some very old cache dates recently -- but if a site disallows googlebot, then sooner or later (and usually sooner) that domain will disappear completely from search results.

You don't need to guess, by the way -- assuming your competitior is example.com. Just type in www.example.com/robots.txt and read what they are using.


10:34 pm on Aug 11, 2006 (gmt 0)

5+ Year Member

Thanks for your help.

When I'm doing this www.example.com/robots.txt with my own site I get the info you describe.
But when doing it with my competitor I unfortunately get their homepage.
Is there anything else I can do?


Featured Threads

Hot Threads This Week

Hot Threads This Month