Welcome to WebmasterWorld Guest from

Forum Moderators: open

Message Too Old, No Replies

Inktomi/Hotbot going indexless?

Websites no longer indexed more than two pages.



7:23 pm on Oct 23, 2003 (gmt 0)

10+ Year Member

So I'm trying to find out how many pages on one of many websites is indexed by Inktomi, so I went in and searched for "Domain:www.whatever.com", but almost no sites come back with more than two web results, and all the sponsored links are spammy. Has Inktomi gone completely paid? I get spidered all the time by Slurp, but only two pages get indexed out of all 700+ pages on my site. I must say now that Inktomi has become completely useless to me. If only two pages are indexed then how can I ever know how effective my website is at being indexed? and what use is it to let inktomi crawl my website if it's just going to throw out all the results? Even most of the huge sites out there aren't listing more than a few results.


7:27 pm on Oct 23, 2003 (gmt 0)

10+ Year Member

The domain:www.domain.com search doesn't work for me (don't know if it ever has - I've never used that method for HotBot.)

What I do is search for "domain" with everything but www.domain.com excluded (preferences), and I get all of the pages that Ink has in their index right now (which matches what they are spidering).



7:29 pm on Oct 23, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member

You can see how many pages Inktomi has indexed by searching domain:mysite.com over at Pure Search.


7:36 pm on Oct 24, 2003 (gmt 0)

10+ Year Member

But why won't the ones listed on Pure Search show up in other inktomi enabled engines? Why only two?


10:14 pm on Oct 24, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member

I remember reading here that the default setting is 2 results. PositionTech overrides the default setting when the domain: prefix is used.


"Our search results are limited to two URLs per domain. We believe this enhances the users experience as searchers are given a better selection of domains from which to evaluate. The "domain:" prefix overrides our default 2 doc setting by allowing an unlimited number of URLs from the same domain to display. MSN, Hotbot and others may be displaying two URLs with the "domain:" prefix but not because only two URLs are in Inktomi's indexed but because they are defaulting to two unique URL per domain per search."


Featured Threads

Hot Threads This Week

Hot Threads This Month