Forum Moderators: open

Message Too Old, No Replies

Question about the Inktomi/Yahoo! bot

         

xwil

5:32 am on Mar 24, 2004 (gmt 0)

10+ Year Member



I changed my site a couple of months ago, using different domain names as well as different CMS's. The previous site was well crawled so I forwarded the domain to the new one and watched closely what the search engines would do.

It appears as if Google picked everything up just fine after the last "dance".

I have noticed a big difference in the Inktomi bot however. My old CMS used a /modules.php page for much of the content, the new one does not so I copied my new index page to the old modules.php location so anyone clicking on an old link would at least go to the main page.

The Inktomi bot seems to be validating links, and has been doing so every 10 minutes for probably 3 months now. All of the links to be verified are all the same old /modules.php that is actually the new index.php page, the bot has not yet found even one new page!?

I souldn't really complain, I have no idea how Inktomi picked me up and I am glad that I am there without paying anything. Just curious if I have done the right thing my putting the phantom page there, should I take it out so Inktomi will be forced to recrawl? or will the bot finally realize that all of these links are actually the same?