| Welcome to WebmasterWorld Guest from 184.108.40.206 |
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
|Pubcon Platinum Sponsor 2014|
do spiders look at that?
| 8:26 pm on Jan 14, 2003 (gmt 0)|
Is how fresh you content a criteria when spidering occurs?
| 8:49 pm on Jan 14, 2003 (gmt 0)|
I think that depends,
On a site I co manage (that changes content pretty frequently, and has high traffic volume), I see spiders more often than on a lower-trafficked site (where content does not change that often).
I think the age of the content may well influence the ranking of the site, at least with the 'top5' search engines.
| 8:56 pm on Jan 14, 2003 (gmt 0)|
this thread dealt with that very issue, specific to googlebot but more than likely applies to other bots as well.
Are you using If Modified Since? [webmasterworld.com]
All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved