Welcome to WebmasterWorld Guest from 34.229.24.100

Forum Moderators: mademetop

Message Too Old, No Replies

Code to get spiders to revisit

What is the code to get spiders to revisit a site

     
8:04 pm on Jan 16, 2001 (gmt 0)

Preferred Member

10+ Year Member

joined:Jan 16, 2001
posts:585
votes: 0


I know there is a meta tag code that will instruct spiders to re-visit on a stated basis, such as
every 15 days.

Does this still work and is it good to use? Please send me the code if you know it.

Thanks

7:44 pm on Jan 17, 2001 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Aug 12, 2000
posts:1808
votes: 0


Welcome to WmW Acternaweb!!!!

The code for the meta tag that you are talking about is:

<META NAME=revisit-after CONTENT="14 days">

This is not very effective anymore, since most spidering engines are currently ignoring meta tags. Additionally, most spiders do not obey this command. I do not think there is a penalty for including this in the code, but bear in mind that it will not be much of an asset.

Good luck!
2M

3:46 pm on Jan 22, 2001 (gmt 0)

Junior Member

10+ Year Member

joined:Dec 19, 2000
posts:193
votes: 0


I think no spider for a big SE can afford to take commands like that. Lets assume there are one million pages out there that switch form 15 days to 7 days. That would oblviously double the load on the link the spider's on. Now most spiders creators think in economic terms, so they have barely enough bandwidth. This would thus lead to a collapse of the spider.

I have however seen spiders come back between daily (the spider of where I am hosted, an AV-type spider) and once every 25-30 days. there are spiders i see once and never again.