homepage Welcome to WebmasterWorld Guest from
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / WebmasterWorld / New To Web Development
Forum Library, Charter, Moderators: brotherhood of lan & mack

New To Web Development Forum

Newbee question about Google cache/bot/serp

 11:25 pm on Jul 31, 2006 (gmt 0)

I have discovered that a competitor's cache is more than 6 month old.
Before that they also had som ups and downs on the Google serp.
IF you are doing somthing that Google don't like, is it then a common solution to stop bots spidering your web (and therby getting old cache)?



 2:02 pm on Aug 8, 2006 (gmt 0)

If you are doing something which Google does not like then you are banned.


 8:47 pm on Aug 8, 2006 (gmt 0)

Thanks for replay.
I thought maybe our competitor kept their serp by disalow the bots and thereby keep high ranking (based on facts that their cache is nearly 8 month old)


 9:13 pm on Aug 8, 2006 (gmt 0)

Only Google knows of course.

If they are banned they disappear (from Google) if they just dropped in the listings or are not visited often they lose rank or may be penalised in some way.


 11:33 pm on Aug 8, 2006 (gmt 0)

Google has had some very old cache dates recently -- but if a site disallows googlebot, then sooner or later (and usually sooner) that domain will disappear completely from search results.

You don't need to guess, by the way -- assuming your competitior is example.com. Just type in www.example.com/robots.txt and read what they are using.


 10:34 pm on Aug 11, 2006 (gmt 0)

Thanks for your help.

When I'm doing this www.example.com/robots.txt with my own site I get the info you describe.
But when doing it with my competitor I unfortunately get their homepage.
Is there anything else I can do?

Global Options:
 top home search open messages active posts  

Home / Forums Index / WebmasterWorld / New To Web Development
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved