Welcome to WebmasterWorld Guest from

Forum Moderators: Ocean10000 & incrediBILL

Message Too Old, No Replies


do spiders look at that?



8:26 pm on Jan 14, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member

Is how fresh you content a criteria when spidering occurs?


8:49 pm on Jan 14, 2003 (gmt 0)

10+ Year Member

I think that depends,

On a site I co manage (that changes content pretty frequently, and has high traffic volume), I see spiders more often than on a lower-trafficked site (where content does not change that often).

I think the age of the content may well influence the ranking of the site, at least with the 'top5' search engines.



8:56 pm on Jan 14, 2003 (gmt 0)

WebmasterWorld Administrator jatar_k is a WebmasterWorld Top Contributor of All Time 10+ Year Member

this thread dealt with that very issue, specific to googlebot but more than likely applies to other bots as well.

Are you using If Modified Since? [webmasterworld.com]


Featured Threads

Hot Threads This Week

Hot Threads This Month