| Welcome to WebmasterWorld Guest from 188.8.131.52 |
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
|Become a Pro Member|
do spiders look at that?
Is how fresh you content a criteria when spidering occurs?
I think that depends,
On a site I co manage (that changes content pretty frequently, and has high traffic volume), I see spiders more often than on a lower-trafficked site (where content does not change that often).
I think the age of the content may well influence the ranking of the site, at least with the 'top5' search engines.
this thread dealt with that very issue, specific to googlebot but more than likely applies to other bots as well.
Are you using If Modified Since? [webmasterworld.com]
All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved