Welcome to WebmasterWorld Guest from 54.196.244.186

Forum Moderators: open

Message Too Old, No Replies

Spidering but not visiting new pages?

     
7:32 pm on Oct 15, 2000 (gmt 0)

Administrator from GB 

WebmasterWorld Administrator engine is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:May 9, 2000
posts:22318
votes: 240


I've been monitoring Ink's spidering for some weeks and noticed it is NOT picking up new pages. It's revisiting old pages almost daily.
Old pages with links are not being followed.

Anyone else seeing the same pattern?

2:58 pm on Oct 16, 2000 (gmt 0)

Full Member

10+ Year Member

joined:July 22, 2000
posts:329
votes: 0


Yep engine I am seeing the same thing.. Seems to be spidering pages that were dropped back in July