Yahoo! Spider requests only 1 or 2 pages per visit.
geoffyp
9:15 pm on Aug 22, 2006 (gmt 0)
I manage several large sites. I have noticed that Yahoo!'s "Inktomisearch" bot rarely requests more than 1 or 2 pages per visit. Can anyone tell me if this is normal behavior for Inktomisearch?
No other search engines seem to have any trouble spidering/indexing our sites - including the other Yahoo spiders(slurp). Thanks in advance, geoffyp
jdMorgan
4:12 am on Aug 28, 2006 (gmt 0)
The first thing I'd do is verify that this UA is coming from an IP range with RDNS resolving to Yahoo! or Inktomi Corp.
