Welcome to WebmasterWorld Guest from

Forum Moderators: Ocean10000 & incrediBILL & keyplyr

Message Too Old, No Replies


do spiders look at that?

8:26 pm on Jan 14, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Mar 12, 2002
votes: 0

Is how fresh you content a criteria when spidering occurs?
8:49 pm on Jan 14, 2003 (gmt 0)

Junior Member

10+ Year Member

joined:Dec 19, 2000
votes: 0

I think that depends,

On a site I co manage (that changes content pretty frequently, and has high traffic volume), I see spiders more often than on a lower-trafficked site (where content does not change that often).

I think the age of the content may well influence the ranking of the site, at least with the 'top5' search engines.


8:56 pm on Jan 14, 2003 (gmt 0)


WebmasterWorld Administrator jatar_k is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:July 24, 2001
votes: 0

this thread dealt with that very issue, specific to googlebot but more than likely applies to other bots as well.

Are you using If Modified Since? [webmasterworld.com]