| Welcome to WebmasterWorld Guest from 22.214.171.124 |
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
|Pubcon Platinum Sponsor 2014|
|Spidering but not visiting new pages?|
| 7:32 pm on Oct 15, 2000 (gmt 0)|
I've been monitoring Ink's spidering for some weeks and noticed it is NOT picking up new pages. It's revisiting old pages almost daily.
Old pages with links are not being followed.
Anyone else seeing the same pattern?
| 2:58 pm on Oct 16, 2000 (gmt 0)|
Yep engine I am seeing the same thing.. Seems to be spidering pages that were dropped back in July
All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved