Forum Moderators: open
how does freshbot decided what pages it sniffs? i have gotten visited regularly by freshy the past few days, and it seems to pick the most random pages. it gets my default page, and my links page, etc. but it doesn't hit my storefront. it also gobbles up my message board posts, constantly sniffing the new posts. what gives? how do i get my storefront sniffed by freshbot? i know it only really sniffs the "fresh" pages (my default page [PR5], and message board get new content every day). but how will it know if my storefront page gets new content, if it doesn't even check? thanks in advance.
Matt
Mhh, could something like a modified date in server header do?
If you have a product for sale, you could put up a new page to coincide with other advertising, for instance TV .
Your new page will appear well in the serps for two or three days after the fresh bot has seen it, so time the presentation of this page to the freshbot to coincide with product launches and general awareness.
(I'm doing this daily upload because my site hasn't been fully spidered until now and I thought it would be an impulse to get more sites spidered - i hope google doesn't count that as spam (?))