Welcome to WebmasterWorld Guest from

Forum Moderators: open

Message Too Old, No Replies

Spidering but not visiting new pages?



7:32 pm on Oct 15, 2000 (gmt 0)

WebmasterWorld Administrator engine is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

I've been monitoring Ink's spidering for some weeks and noticed it is NOT picking up new pages. It's revisiting old pages almost daily.
Old pages with links are not being followed.

Anyone else seeing the same pattern?


2:58 pm on Oct 16, 2000 (gmt 0)

10+ Year Member

Yep engine I am seeing the same thing.. Seems to be spidering pages that were dropped back in July

Featured Threads

Hot Threads This Week

Hot Threads This Month