Forum Moderators: open

Message Too Old, No Replies

Question about AV's quick spider

         

dave83

7:32 pm on May 2, 2001 (gmt 0)



Is the scooter spider that visits immediately after a submission actually spidering the page or just verifying the URL is active and passing the URL on to scooter for actual psidering at later date?

Air

12:39 am on May 3, 2001 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



It actually spiders the page.

Robert Charlton

6:42 am on May 3, 2001 (gmt 0)

WebmasterWorld Administrator 10+ Year Member Top Contributors Of The Month



I think it spiders the page and then injects it with a deadly venom. The page dies a slow, painful, and anonymous death....

Eric_Lander

3:29 pm on May 7, 2001 (gmt 0)

10+ Year Member



>>The page dies a slow, painful, and anonymous death....

...And quickly drops to a 6-feet-under world never to be seen by anything but little guy known as scooter.