Welcome to WebmasterWorld Guest from 18.104.22.168
Forum Moderators: open
I only use the index,follow and haven't seen any drops from AV but I haven't seen any overly deep spidering or indexing either. If it's a problem I could remove it. Any thoughts on the usefulness of this tag with AV lately? Help or Hindrance?
I have not see AV do ANY deep spidering all my log files show AV getting the index.htm & robots.txt then it's off an running not grabing any other page on the site?
Also, (off this topic) I have not see AV pick up anny new pages that were in 2001. (i.e. created a page in 12-3-00 and submited it, still not there... ) I also looked at other KW terms that might show new listings (i.e. football) and the newest date I've see in like 1-Dec-2001..